2026-01-29 06:00:19 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-29 06:00:19 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-29 06:00:19 [auto1.es] INFO: Starting spider auto1.es
2026-01-29 06:00:19 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-29 06:00:19 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-29 06:00:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-29 06:00:19 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-29 06:00:19 [scrapy.extensions.telnet] INFO: Telnet Password: c36ff1abc532a3ed
2026-01-29 06:00:19 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-01-29 06:00:19 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_25_2026-01-29T06_00_01.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-01-29 06:00:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-29 06:00:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-29 06:00:19 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-29 06:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-29 06:00:19 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-29 06:00:19 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-29 06:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:00:19 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-29 06:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-29 06:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:19 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-29 06:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-29 06:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-29 06:00:19 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-29 06:00:19 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-29 06:00:19 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-29 06:00:19 [scrapy.core.engine] INFO: Spider opened
2026-01-29 06:00:19 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-29 06:00:19 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-01-29 06:00:19 [scrapy-playwright] INFO: Starting download handler
2026-01-29 06:00:19 [scrapy-playwright] INFO: Starting download handler
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-29 06:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-29 06:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-29 06:00:28 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:28 [auto1.es] INFO: Found listing with ID: XS50446
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50446%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [auto1.es] INFO: Scrape type for XS50446: 2
2026-01-29 06:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:28 [auto1.es] INFO: Found listing with ID: SL00738
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL00738%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for SL00738: 1
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: FD44539
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD44539%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for FD44539: 1
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: YJ03933
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ03933%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for YJ03933: 2
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: DV84781
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV84781%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for DV84781: 1
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: AS19038
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for AS19038: 1
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: FT52333
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT52333%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for FT52333: 2
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: YC35839
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC35839%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for YC35839: 2
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: GA27158
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA27158%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for GA27158: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: EP09349
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP09349%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for EP09349: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: FP57235
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP57235%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for FP57235: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: GR81634
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR81634%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for GR81634: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: GH34760
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH34760%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for GH34760: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: ZK09495
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK09495%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for ZK09495: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: FC73703
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC73703%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for FC73703: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: JW61635
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW61635%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for JW61635: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: HU77878
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU77878%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for HU77878: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: CT63528
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT63528%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for CT63528: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: JH19124
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH19124%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for JH19124: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: TF24269
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF24269%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for TF24269: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: BP61591
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for BP61591: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: UB75333
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB75333%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for UB75333: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: ZM34040
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM34040%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for ZM34040: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: EM24266
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM24266%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for EM24266: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: BJ69779
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ69779%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for BJ69779: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: NS10897
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS10897%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for NS10897: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: RM34315
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM34315%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for RM34315: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: NY34007
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY34007%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for NY34007: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: CN46229
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN46229%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for CN46229: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: RT15505
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT15505%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for RT15505: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: BD60127
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD60127%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for BD60127: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: UN86543
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN86543%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for UN86543: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: GN21323
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN21323%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for GN21323: 2
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: UZ84215
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ84215%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for UZ84215: 1
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: UF75350
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF75350%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for UF75350: 0
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: DX79549
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX79549%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for DX79549: 0
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: AH93641
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH93641%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for AH93641: 0
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: MX49357
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX49357%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for MX49357: 0
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: TM34191
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM34191%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for TM34191: 0
2026-01-29 06:00:29 [auto1.es] INFO: Found listing with ID: FX73472
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX73472%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [auto1.es] INFO: Scrape type for FX73472: 0
2026-01-29 06:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS50446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT52333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV84781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL00738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: XS50446
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50446%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for XS50446: 2
2026-01-29 06:00:30 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/XS50446/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: SL00738
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS19038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: FD44539
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: YJ03933
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ03933%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for YJ03933: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: DV84781
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: AS19038
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: FT52333
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT52333%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for FT52333: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: YC35839
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC35839%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for YC35839: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: GA27158
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: EP09349
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: FP57235
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP57235%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for FP57235: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: GR81634
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR81634%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for GR81634: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: GH34760
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: ZK09495
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: FC73703
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC73703%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for FC73703: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: JW61635
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW61635%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for JW61635: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: HU77878
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD44539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: CT63528
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: JH19124
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH19124%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for JH19124: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: TF24269
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ03933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: BP61591
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for BP61591: 2
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: UB75333
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: ZM34040
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: EM24266
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: BJ69779
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: NS10897
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS10897%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for NS10897: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: RM34315
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM34315%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for RM34315: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: NY34007
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY34007%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for NY34007: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: CN46229
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: RT15505
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT15505%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for RT15505: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: BD60127
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD60127%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for BD60127: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: UN86543
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN86543%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for UN86543: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: GN21323
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN21323%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for GN21323: 2
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: UZ84215
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: UF75350
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF75350%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for UF75350: 0
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: DX79549
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX79549%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for DX79549: 0
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: AH93641
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH93641%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for AH93641: 0
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: MX49357
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX49357%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for MX49357: 0
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: TM34191
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM34191%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for TM34191: 0
2026-01-29 06:00:30 [auto1.es] INFO: Found listing with ID: FX73472
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX73472%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.es] INFO: Scrape type for FX73472: 0
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC35839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA27158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR81634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP09349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP57235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH34760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC73703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK09495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ84215/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN21323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN86543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS50446> (referer: https://www.auto1.com/v1/car-details-view/XS50446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT52333> (referer: https://www.auto1.com/v1/car-details-view/FT52333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV84781> (referer: https://www.auto1.com/v1/car-details-view/DV84781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0cf996-d89e-5789-96a3-e0eac559a3f1 with identifier: XS50446
2026-01-29 06:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0cf996-d89e-5789-96a3-e0eac559a3f1 with scrape type 2
2026-01-29 06:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb0cf996-d89e-5789-96a3-e0eac559a3f1 with scrape type 2
2026-01-29 06:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb0cf996-d89e-5789-96a3-e0eac559a3f1, identifier: XS50446
2026-01-29 06:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb0cf996-d89e-5789-96a3-e0eac559a3f1 with identifier: XS50446
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-29 06:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-29 06:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb0cf996-d89e-5789-96a3-e0eac559a3f1 with identifier: XS50446
2026-01-29 06:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb0cf996-d89e-5789-96a3-e0eac559a3f1 with identifier: XS50446 to the API
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS50446>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-29T16:17:22Z',
'fuel_type': 'petrol',
'id': 'fb0cf996-d89e-5789-96a3-e0eac559a3f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS50446',
'listing': 'auction',
'location': 'ES, Sevilla',
'make': 'Ford',
'model': 'Focus',
'odometer': 108163,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2018}
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50446%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [auto1.es] INFO: Saving data for XS50446: {'auction_closing_time': 1769703442.0, 'created_time': 1767703553.617722, 'last_price_update_time': 1769666433.202983}
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS50446') HTTP/1.1" 204 0
2026-01-29 06:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA27158> (referer: https://www.auto1.com/v1/car-details-view/GA27158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ03933> (referer: https://www.auto1.com/v1/car-details-view/YJ03933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL00738> (referer: https://www.auto1.com/v1/car-details-view/SL00738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC35839> (referer: https://www.auto1.com/v1/car-details-view/YC35839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS19038> (referer: https://www.auto1.com/v1/car-details-view/AS19038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 with identifier: FT52333
2026-01-29 06:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 with scrape type 2
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 with scrape type 2
2026-01-29 06:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a07fdc76-e69f-58b2-b15c-fd4bc70d1d61, identifier: FT52333
2026-01-29 06:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d96cd19-41f3-5b98-ba63-f25242eee3c2 with identifier: DV84781
2026-01-29 06:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d96cd19-41f3-5b98-ba63-f25242eee3c2 with scrape type 1
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3d96cd19-41f3-5b98-ba63-f25242eee3c2
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_53c34409d4a0dd80fce1eeb921824b4c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_53c34409d4a0dd80fce1eeb921824b4c.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_8e80fe8980b20ee33a8c176a7d440957.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_8e80fe8980b20ee33a8c176a7d440957.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_8ed9e8f8bb862a72c213857205424be9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_8ed9e8f8bb862a72c213857205424be9.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_37d66d21c182ec35c76ffc5a126ab0eb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_37d66d21c182ec35c76ffc5a126ab0eb.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_be878f505dfa072c6374999e3e4cce38.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_be878f505dfa072c6374999e3e4cce38.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_f22298cff50ec2eb5442f2bcb859c532.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_f22298cff50ec2eb5442f2bcb859c532.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_9b5b46bed0dcc4df468e56c850a29eb3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_9b5b46bed0dcc4df468e56c850a29eb3.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_a417d20b933dfac6b6bce7be9221aaef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_a417d20b933dfac6b6bce7be9221aaef.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_be1d50759ece453a62fe93d0a6049996.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_be1d50759ece453a62fe93d0a6049996.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_a7bd7ec73206120f334e42224a61e2f1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_a7bd7ec73206120f334e42224a61e2f1.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_19722b4435e2660dbd672d79acc0b7f2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_19722b4435e2660dbd672d79acc0b7f2.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_90cf82871c4bb5f7a363d3d28893774b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_90cf82871c4bb5f7a363d3d28893774b.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_71ae46c3c3f74628a4cdd451c341d1ef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_71ae46c3c3f74628a4cdd451c341d1ef.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_1bc5026cbea60acdf2fbfcde2391cec2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_1bc5026cbea60acdf2fbfcde2391cec2.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_1c4b9d7581570b5405718f62d92d3c29.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_1c4b9d7581570b5405718f62d92d3c29.jpg already downloaded
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F02%252Fbe02ad1d81a62e5c3ac4ac41da7b13e5%252Fpa%252FDV84781_365b312b15b8b42f6142337ac379cb61.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_365b312b15b8b42f6142337ac379cb61.jpg already downloaded
2026-01-29 06:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d96cd19-41f3-5b98-ba63-f25242eee3c2, identifier: DV84781
2026-01-29 06:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 with identifier: FT52333
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 with identifier: FT52333
2026-01-29 06:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 spider: auto1.es
2026-01-29 06:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a07fdc76-e69f-58b2-b15c-fd4bc70d1d61 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-01-29T16:51:00Z',
'fuel_type': 'diesel',
'id': 'a07fdc76-e69f-58b2-b15c-fd4bc70d1d61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT52333',
'listing': 'auction',
'location': 'ES',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 153879,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-30',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
'transmission': 'manual',
'trim': 'Premium L1',
'year': 2022}
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT52333%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [auto1.es] INFO: Saving data for FT52333: {'auction_closing_time': 1769705460.0, 'created_time': 1768401984.652661, 'last_price_update_time': 1769666434.357113}
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FT52333') HTTP/1.1" 204 0
2026-01-29 06:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d96cd19-41f3-5b98-ba63-f25242eee3c2 with identifier: DV84781
2026-01-29 06:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d96cd19-41f3-5b98-ba63-f25242eee3c2 with identifier: DV84781
2026-01-29 06:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173084 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173084
2026-01-29 06:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3d96cd19-41f3-5b98-ba63-f25242eee3c2 spider: auto1.es
2026-01-29 06:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3d96cd19-41f3-5b98-ba63-f25242eee3c2 due to rule: high_mileage_for_country.json, error: 173084 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173084
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-01-29T16:40:40Z',
'fuel_type': 'petrol',
'id': '3d96cd19-41f3-5b98-ba63-f25242eee3c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV84781',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 173084,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_53c34409d4a0dd80fce1eeb921824b4c.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_8e80fe8980b20ee33a8c176a7d440957.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_8ed9e8f8bb862a72c213857205424be9.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_37d66d21c182ec35c76ffc5a126ab0eb.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_be878f505dfa072c6374999e3e4cce38.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_f22298cff50ec2eb5442f2bcb859c532.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_9b5b46bed0dcc4df468e56c850a29eb3.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_a417d20b933dfac6b6bce7be9221aaef.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_be1d50759ece453a62fe93d0a6049996.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_a7bd7ec73206120f334e42224a61e2f1.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_19722b4435e2660dbd672d79acc0b7f2.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_90cf82871c4bb5f7a363d3d28893774b.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_71ae46c3c3f74628a4cdd451c341d1ef.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_1bc5026cbea60acdf2fbfcde2391cec2.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_1c4b9d7581570b5405718f62d92d3c29.jpg',
'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_365b312b15b8b42f6142337ac379cb61.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_53c34409d4a0dd80fce1eeb921824b4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_8e80fe8980b20ee33a8c176a7d440957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_8ed9e8f8bb862a72c213857205424be9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_37d66d21c182ec35c76ffc5a126ab0eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_be878f505dfa072c6374999e3e4cce38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_f22298cff50ec2eb5442f2bcb859c532.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_9b5b46bed0dcc4df468e56c850a29eb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_a417d20b933dfac6b6bce7be9221aaef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_be1d50759ece453a62fe93d0a6049996.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_a7bd7ec73206120f334e42224a61e2f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_19722b4435e2660dbd672d79acc0b7f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_90cf82871c4bb5f7a363d3d28893774b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_71ae46c3c3f74628a4cdd451c341d1ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_1bc5026cbea60acdf2fbfcde2391cec2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_1c4b9d7581570b5405718f62d92d3c29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d96cd19-41f3-5b98-ba63-f25242eee3c2/3d96cd19-41f3-5b98-ba63-f25242eee3c2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/02/be02ad1d81a62e5c3ac4ac41da7b13e5/pa/DV84781_365b312b15b8b42f6142337ac379cb61.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 1.0 TFSI Attracted',
'transmission': 'manual',
'trim': 'Attracted',
'year': 2018}
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV84781%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [auto1.es] INFO: Saving data for DV84781: {'created_time': 1769666434.610165, 'last_price_update_time': 1769666434.610177, 'auction_closing_time': 1769704840.0}
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV84781') HTTP/1.1" 204 0
2026-01-29 06:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80819aa5-0344-547f-a661-87722576e776 with identifier: GA27158
2026-01-29 06:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80819aa5-0344-547f-a661-87722576e776 with scrape type 1
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 80819aa5-0344-547f-a661-87722576e776
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_514b90b4fc37c0240d7cd8b1991dce22.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_514b90b4fc37c0240d7cd8b1991dce22.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_4b389963f48f08c057625bd79794b7dd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_4b389963f48f08c057625bd79794b7dd.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_cfb8da277e44d847fe340705f08bdb4a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_cfb8da277e44d847fe340705f08bdb4a.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_5ddf2e5d75fab24a69d4596a8619f7dc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_5ddf2e5d75fab24a69d4596a8619f7dc.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_0eb2a1d043303338d101949b42a675c3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_0eb2a1d043303338d101949b42a675c3.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_94d318377cabbc6b56875495ffece2e7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_94d318377cabbc6b56875495ffece2e7.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_50527c09be997347cf1729da214189e3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_50527c09be997347cf1729da214189e3.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_f8ffff0a9efb69e7ae5b7548f29805fc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_f8ffff0a9efb69e7ae5b7548f29805fc.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_d16e90471b66819752695f1744ba0a7a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_d16e90471b66819752695f1744ba0a7a.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_4cfe31e2c4b56b9145a79a4327044cce.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_4cfe31e2c4b56b9145a79a4327044cce.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_c9e6ef74aa3302e88dc9f3f7e3924e3d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_c9e6ef74aa3302e88dc9f3f7e3924e3d.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_1d3f3c194d3d4e0960818cb31c30e3a8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_1d3f3c194d3d4e0960818cb31c30e3a8.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_6047f98626af0e700372e4dc2b05a5ff.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_6047f98626af0e700372e4dc2b05a5ff.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_98fd7a7db8225cd00593d13f130948fd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_98fd7a7db8225cd00593d13f130948fd.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_aca39035f18f6f3bc0576569e65f3635.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_aca39035f18f6f3bc0576569e65f3635.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fc7%252F45c7816876f66ff859b4ec867c50cd81%252Fpa%252FGA27158_a82c9c1d4701b0076420d77733fd4292.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_a82c9c1d4701b0076420d77733fd4292.jpg already downloaded
2026-01-29 06:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 80819aa5-0344-547f-a661-87722576e776, identifier: GA27158
2026-01-29 06:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff98a367-34cd-5550-9144-4e86b3c22956 with identifier: YJ03933
2026-01-29 06:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff98a367-34cd-5550-9144-4e86b3c22956 with scrape type 2
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff98a367-34cd-5550-9144-4e86b3c22956 with scrape type 2
2026-01-29 06:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ff98a367-34cd-5550-9144-4e86b3c22956, identifier: YJ03933
2026-01-29 06:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84d9bb7-e027-5f47-b1d4-965484b25892 with identifier: SL00738
2026-01-29 06:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84d9bb7-e027-5f47-b1d4-965484b25892 with scrape type 1
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f84d9bb7-e027-5f47-b1d4-965484b25892
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_56b7aac4a92d715be3d1acdf4767f11a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_56b7aac4a92d715be3d1acdf4767f11a.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_20bb3103e1e9af9d04f6c8b366a5b7bf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_20bb3103e1e9af9d04f6c8b366a5b7bf.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_18dbf60380b3c33a234e23a103dc1a89.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_18dbf60380b3c33a234e23a103dc1a89.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_e38a2142827b1449479230bce3b79d1f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_e38a2142827b1449479230bce3b79d1f.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_b0b360e88e8e44d59bff8f8075fd2f36.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_b0b360e88e8e44d59bff8f8075fd2f36.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_3c56efff052afd3a21f980629e632d54.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_3c56efff052afd3a21f980629e632d54.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_1d90797488ba0502ffd9515a30e05a4c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1d90797488ba0502ffd9515a30e05a4c.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_9ba67f168bc8d0e27fa2935837b5201c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_9ba67f168bc8d0e27fa2935837b5201c.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_3aac55eb1e6580364b451a1b84dcb763.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_3aac55eb1e6580364b451a1b84dcb763.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_1514441dc50eacd883ee0045858a3716.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1514441dc50eacd883ee0045858a3716.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_1719b86021ef921c346f7d219df1e32d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1719b86021ef921c346f7d219df1e32d.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_ef530da0deb01df563ed5f815142809c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_ef530da0deb01df563ed5f815142809c.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_2f481376254cc4b6e7891303bc39e22a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_2f481376254cc4b6e7891303bc39e22a.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_cca72fdf9f501333b026017fb3ed95df.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_cca72fdf9f501333b026017fb3ed95df.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_4a401c6ee99625e04736242a6dcb07ee.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_4a401c6ee99625e04736242a6dcb07ee.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7d8a2601678702c5f91d4e436e9c0%252Fpa%252FSL00738_2ae064441ce95e9a5c5346f08f45e7c1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_2ae064441ce95e9a5c5346f08f45e7c1.jpg already downloaded
2026-01-29 06:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f84d9bb7-e027-5f47-b1d4-965484b25892, identifier: SL00738
2026-01-29 06:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e with identifier: YC35839
2026-01-29 06:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e with scrape type 2
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e with scrape type 2
2026-01-29 06:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e, identifier: YC35839
2026-01-29 06:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038
2026-01-29 06:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50705a58-667b-5f41-a4ff-17f99a8cbb7f with scrape type 1
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 50705a58-667b-5f41-a4ff-17f99a8cbb7f
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_d21f596e358ccb0a732b600ba3c011bc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_d21f596e358ccb0a732b600ba3c011bc.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_2d42e74b3464a1e62816d2766c591665.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_2d42e74b3464a1e62816d2766c591665.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_341acc63bb95e36afebde59d3c81b6d9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_341acc63bb95e36afebde59d3c81b6d9.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_f83339672d1b33e5eefb9db40449f671.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_f83339672d1b33e5eefb9db40449f671.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_7a7de8b65f458d10c56d0e4499caba30.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_7a7de8b65f458d10c56d0e4499caba30.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_67503dcf3be7e4fa1f30b0c0641ee773.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_67503dcf3be7e4fa1f30b0c0641ee773.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_45056b61c263a5f72a441135a895ef2b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_45056b61c263a5f72a441135a895ef2b.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_d573d6195c86716503d15c10e412388e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_d573d6195c86716503d15c10e412388e.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_819f55cba7cbfb814cabd28370634193.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_819f55cba7cbfb814cabd28370634193.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_1ed00907dd28910d15555cbf94b56520.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_1ed00907dd28910d15555cbf94b56520.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_bf1e3184e81110542b1482b4f67f60ec.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_bf1e3184e81110542b1482b4f67f60ec.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_23f4a340e6d0763c0cab4d3fdf05606c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_23f4a340e6d0763c0cab4d3fdf05606c.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_f39b2f9739a4ffe20dcc4a6c5c95d005.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_f39b2f9739a4ffe20dcc4a6c5c95d005.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_9e225af01dc032df66b82dd0d504e7b7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_9e225af01dc032df66b82dd0d504e7b7.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_6d6c3d1f5375666433a374e24ca5d7c4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_6d6c3d1f5375666433a374e24ca5d7c4.jpg already downloaded
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c8844fc118def35a0a9aceef0b11e9b%252Fpa%252FAS19038_ed3b4c10b4b037e9eed8a2bf3ddd47b3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_ed3b4c10b4b037e9eed8a2bf3ddd47b3.jpg already downloaded
2026-01-29 06:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50705a58-667b-5f41-a4ff-17f99a8cbb7f, identifier: AS19038
2026-01-29 06:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 80819aa5-0344-547f-a661-87722576e776 with identifier: GA27158
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-29 06:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 80819aa5-0344-547f-a661-87722576e776 with identifier: GA27158
2026-01-29 06:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 80819aa5-0344-547f-a661-87722576e776 with identifier: GA27158 to the API
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GA27158>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 250,
'expiration_date': '2026-01-29T16:50:27Z',
'fuel_type': 'petrol',
'id': '80819aa5-0344-547f-a661-87722576e776',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA27158',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 105460,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_514b90b4fc37c0240d7cd8b1991dce22.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_4b389963f48f08c057625bd79794b7dd.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_cfb8da277e44d847fe340705f08bdb4a.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_5ddf2e5d75fab24a69d4596a8619f7dc.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_0eb2a1d043303338d101949b42a675c3.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_94d318377cabbc6b56875495ffece2e7.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_50527c09be997347cf1729da214189e3.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_f8ffff0a9efb69e7ae5b7548f29805fc.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_d16e90471b66819752695f1744ba0a7a.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_4cfe31e2c4b56b9145a79a4327044cce.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_c9e6ef74aa3302e88dc9f3f7e3924e3d.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_1d3f3c194d3d4e0960818cb31c30e3a8.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_6047f98626af0e700372e4dc2b05a5ff.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_98fd7a7db8225cd00593d13f130948fd.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_aca39035f18f6f3bc0576569e65f3635.jpg',
'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_a82c9c1d4701b0076420d77733fd4292.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_514b90b4fc37c0240d7cd8b1991dce22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_4b389963f48f08c057625bd79794b7dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_cfb8da277e44d847fe340705f08bdb4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_5ddf2e5d75fab24a69d4596a8619f7dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_0eb2a1d043303338d101949b42a675c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_94d318377cabbc6b56875495ffece2e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_50527c09be997347cf1729da214189e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_f8ffff0a9efb69e7ae5b7548f29805fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_d16e90471b66819752695f1744ba0a7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_4cfe31e2c4b56b9145a79a4327044cce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_c9e6ef74aa3302e88dc9f3f7e3924e3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_1d3f3c194d3d4e0960818cb31c30e3a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_6047f98626af0e700372e4dc2b05a5ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_98fd7a7db8225cd00593d13f130948fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_aca39035f18f6f3bc0576569e65f3635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80819aa5-0344-547f-a661-87722576e776/80819aa5-0344-547f-a661-87722576e776_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c7/45c7816876f66ff859b4ec867c50cd81/pa/GA27158_a82c9c1d4701b0076420d77733fd4292.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Turbo R-Dynamic',
'transmission': 'automatic',
'trim': 'R-Dynamic',
'year': 2019}
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA27158%27 HTTP/1.1" 200 None
2026-01-29 06:00:36 [auto1.es] INFO: Saving data for GA27158: {'created_time': 1769666436.603833, 'last_price_update_time': 1769666436.603843, 'auction_closing_time': 1769705427.0}
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GA27158') HTTP/1.1" 204 0
2026-01-29 06:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ff98a367-34cd-5550-9144-4e86b3c22956 with identifier: YJ03933
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-01-29 06:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ff98a367-34cd-5550-9144-4e86b3c22956 with identifier: YJ03933
2026-01-29 06:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ff98a367-34cd-5550-9144-4e86b3c22956 with identifier: YJ03933 to the API
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ03933>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-01-29T16:53:10Z',
'fuel_type': 'petrol',
'id': 'ff98a367-34cd-5550-9144-4e86b3c22956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ03933',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Citroen',
'model': 'C1',
'odometer': 117519,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-07',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.2 VTi Feel Edition',
'transmission': 'manual',
'trim': 'Feel Edition',
'year': 2017}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ03933%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [auto1.es] INFO: Saving data for YJ03933: {'auction_closing_time': 1769705590.0, 'created_time': 1768377639.094614, 'last_price_update_time': 1769666437.078678}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ03933') HTTP/1.1" 204 0
2026-01-29 06:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f84d9bb7-e027-5f47-b1d4-965484b25892 with identifier: SL00738
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-01-29 06:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f84d9bb7-e027-5f47-b1d4-965484b25892 with identifier: SL00738
2026-01-29 06:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f84d9bb7-e027-5f47-b1d4-965484b25892 with identifier: SL00738 to the API
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL00738>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:37:28Z',
'fuel_type': 'petrol',
'id': 'f84d9bb7-e027-5f47-b1d4-965484b25892',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL00738',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Renault',
'model': 'Clio',
'odometer': 41290,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_56b7aac4a92d715be3d1acdf4767f11a.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_20bb3103e1e9af9d04f6c8b366a5b7bf.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_18dbf60380b3c33a234e23a103dc1a89.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_e38a2142827b1449479230bce3b79d1f.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_b0b360e88e8e44d59bff8f8075fd2f36.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_3c56efff052afd3a21f980629e632d54.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1d90797488ba0502ffd9515a30e05a4c.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_9ba67f168bc8d0e27fa2935837b5201c.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_3aac55eb1e6580364b451a1b84dcb763.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1514441dc50eacd883ee0045858a3716.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1719b86021ef921c346f7d219df1e32d.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_ef530da0deb01df563ed5f815142809c.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_2f481376254cc4b6e7891303bc39e22a.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_cca72fdf9f501333b026017fb3ed95df.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_4a401c6ee99625e04736242a6dcb07ee.jpg',
'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_2ae064441ce95e9a5c5346f08f45e7c1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_56b7aac4a92d715be3d1acdf4767f11a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_20bb3103e1e9af9d04f6c8b366a5b7bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_18dbf60380b3c33a234e23a103dc1a89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_e38a2142827b1449479230bce3b79d1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_b0b360e88e8e44d59bff8f8075fd2f36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_3c56efff052afd3a21f980629e632d54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1d90797488ba0502ffd9515a30e05a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_9ba67f168bc8d0e27fa2935837b5201c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_3aac55eb1e6580364b451a1b84dcb763.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1514441dc50eacd883ee0045858a3716.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_1719b86021ef921c346f7d219df1e32d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_ef530da0deb01df563ed5f815142809c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_2f481376254cc4b6e7891303bc39e22a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_cca72fdf9f501333b026017fb3ed95df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_4a401c6ee99625e04736242a6dcb07ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84d9bb7-e027-5f47-b1d4-965484b25892/f84d9bb7-e027-5f47-b1d4-965484b25892_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7d8a2601678702c5f91d4e436e9c0/pa/SL00738_2ae064441ce95e9a5c5346f08f45e7c1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.3 TCe R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2019}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL00738%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [auto1.es] INFO: Saving data for SL00738: {'created_time': 1769666437.602286, 'last_price_update_time': 1769666437.602298, 'auction_closing_time': 1769704648.0}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL00738') HTTP/1.1" 204 0
2026-01-29 06:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e with identifier: YC35839
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e with identifier: YC35839
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e spider: auto1.es
2026-01-29 06:00:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:20:29Z',
'fuel_type': 'diesel',
'id': 'c1f768d2-ed9a-5b17-9423-e3ce8ac2c69e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC35839',
'listing': 'auction',
'location': 'ES',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 196725,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Life Pack M',
'transmission': 'manual',
'trim': 'Life Pack M',
'year': 2021}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC35839%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [auto1.es] INFO: Saving data for YC35839: {'auction_closing_time': 1769703629.0, 'created_time': 1769003155.317282, 'last_price_update_time': 1769666437.824661}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC35839') HTTP/1.1" 204 0
2026-01-29 06:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151095 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151095
2026-01-29 06:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f spider: auto1.es
2026-01-29 06:00:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 50705a58-667b-5f41-a4ff-17f99a8cbb7f due to rule: high_mileage_for_country.json, error: 151095 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151095
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:12:22Z',
'fuel_type': 'diesel',
'id': '50705a58-667b-5f41-a4ff-17f99a8cbb7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS19038',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 151095,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_d21f596e358ccb0a732b600ba3c011bc.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_2d42e74b3464a1e62816d2766c591665.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_341acc63bb95e36afebde59d3c81b6d9.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_f83339672d1b33e5eefb9db40449f671.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_7a7de8b65f458d10c56d0e4499caba30.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_67503dcf3be7e4fa1f30b0c0641ee773.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_45056b61c263a5f72a441135a895ef2b.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_d573d6195c86716503d15c10e412388e.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_819f55cba7cbfb814cabd28370634193.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_1ed00907dd28910d15555cbf94b56520.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_bf1e3184e81110542b1482b4f67f60ec.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_23f4a340e6d0763c0cab4d3fdf05606c.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_f39b2f9739a4ffe20dcc4a6c5c95d005.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_9e225af01dc032df66b82dd0d504e7b7.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_6d6c3d1f5375666433a374e24ca5d7c4.jpg',
'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_ed3b4c10b4b037e9eed8a2bf3ddd47b3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_d21f596e358ccb0a732b600ba3c011bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_2d42e74b3464a1e62816d2766c591665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_341acc63bb95e36afebde59d3c81b6d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_f83339672d1b33e5eefb9db40449f671.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_7a7de8b65f458d10c56d0e4499caba30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_67503dcf3be7e4fa1f30b0c0641ee773.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_45056b61c263a5f72a441135a895ef2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_d573d6195c86716503d15c10e412388e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_819f55cba7cbfb814cabd28370634193.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_1ed00907dd28910d15555cbf94b56520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_bf1e3184e81110542b1482b4f67f60ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_23f4a340e6d0763c0cab4d3fdf05606c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_f39b2f9739a4ffe20dcc4a6c5c95d005.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_9e225af01dc032df66b82dd0d504e7b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_6d6c3d1f5375666433a374e24ca5d7c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50705a58-667b-5f41-a4ff-17f99a8cbb7f/50705a58-667b-5f41-a4ff-17f99a8cbb7f_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c8844fc118def35a0a9aceef0b11e9b/pa/AS19038_ed3b4c10b4b037e9eed8a2bf3ddd47b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2020}
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [auto1.es] INFO: Saving data for AS19038: {'created_time': 1769666438.104232, 'last_price_update_time': 1769666438.104243, 'auction_closing_time': 1769703142.0}
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AS19038') HTTP/1.1" 204 0
2026-01-29 06:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP57235> (referer: https://www.auto1.com/v1/car-details-view/FP57235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD44539> (referer: https://www.auto1.com/v1/car-details-view/FD44539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be200bc-8ca2-5181-b6f5-a6a67ddebf47 with identifier: FP57235
2026-01-29 06:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be200bc-8ca2-5181-b6f5-a6a67ddebf47 with scrape type 2
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6be200bc-8ca2-5181-b6f5-a6a67ddebf47 with scrape type 2
2026-01-29 06:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6be200bc-8ca2-5181-b6f5-a6a67ddebf47, identifier: FP57235
2026-01-29 06:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6be200bc-8ca2-5181-b6f5-a6a67ddebf47 with identifier: FP57235
2026-01-29 06:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6be200bc-8ca2-5181-b6f5-a6a67ddebf47 with identifier: FP57235
2026-01-29 06:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6be200bc-8ca2-5181-b6f5-a6a67ddebf47 with identifier: FP57235 to the API
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP57235>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:38:40Z',
'fuel_type': 'petrol',
'id': '6be200bc-8ca2-5181-b6f5-a6a67ddebf47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP57235',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Cupra',
'model': 'Leon',
'odometer': 54569,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'Cupra Leon 1.5 eTSI',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP57235%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [auto1.es] INFO: Saving data for FP57235: {'auction_closing_time': 1769704720.0, 'created_time': 1769003581.516821, 'last_price_update_time': 1769666438.704383}
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FP57235') HTTP/1.1" 204 0
2026-01-29 06:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ84215> (referer: https://www.auto1.com/v1/car-details-view/UZ84215/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd51f35-3750-5851-a829-3b78564f2190 with identifier: FD44539
2026-01-29 06:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd51f35-3750-5851-a829-3b78564f2190 with scrape type 1
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3fd51f35-3750-5851-a829-3b78564f2190
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_e56e8b5cea5a13a78b9e69eeffeee573.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_e56e8b5cea5a13a78b9e69eeffeee573.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_d80efc1bcff45f70d2caffee42a3219a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d80efc1bcff45f70d2caffee42a3219a.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_8a973f9b491bfd3b29c03f8d44de283f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_8a973f9b491bfd3b29c03f8d44de283f.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_57cfd331b328a6ee00bde0fefd699134.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_57cfd331b328a6ee00bde0fefd699134.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_4f16b2ddd49683681f094e7bb37620e7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_4f16b2ddd49683681f094e7bb37620e7.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_6118c90cb464a91dad023d8d2ab12dad.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_6118c90cb464a91dad023d8d2ab12dad.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_320f51e402dfc1bfc12966352668b2cb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_320f51e402dfc1bfc12966352668b2cb.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_9f3ba6a0cf7dd64b4081cb3b98afac9e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_9f3ba6a0cf7dd64b4081cb3b98afac9e.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_54b3a6f65ab2727e366459d0078e6501.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_54b3a6f65ab2727e366459d0078e6501.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_9aa6aa6d48fe871eec3c549cec07f218.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_9aa6aa6d48fe871eec3c549cec07f218.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_5fa0b3892240732fce4470b4e175bcb3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_5fa0b3892240732fce4470b4e175bcb3.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_d0a5adde79073e95ce47a9b8b7f61074.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d0a5adde79073e95ce47a9b8b7f61074.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_3f36307b90f24fcdb3a1ccb91f7f77f1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_3f36307b90f24fcdb3a1ccb91f7f77f1.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_d7240fbde6cce48b3ce95106bf21ae70.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d7240fbde6cce48b3ce95106bf21ae70.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_90d849ab7b2ca0f33477ff6c1772482c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_90d849ab7b2ca0f33477ff6c1772482c.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa0%252F1ca0766dea713f5a4ee006548f595075%252Fpa%252FFD44539_5ba6e86257b2fe65059ed678ccc04f7f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_5ba6e86257b2fe65059ed678ccc04f7f.jpg already downloaded
2026-01-29 06:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3fd51f35-3750-5851-a829-3b78564f2190, identifier: FD44539
2026-01-29 06:00:39 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3fd51f35-3750-5851-a829-3b78564f2190 with identifier: FD44539
2026-01-29 06:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3fd51f35-3750-5851-a829-3b78564f2190 with identifier: FD44539
2026-01-29 06:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3fd51f35-3750-5851-a829-3b78564f2190 with identifier: FD44539 to the API
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD44539>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-01-29T16:44:00Z',
'fuel_type': 'petrol',
'id': '3fd51f35-3750-5851-a829-3b78564f2190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD44539',
'listing': 'auction',
'location': 'ES, A Cañiza Pontevedra',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 22877,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_e56e8b5cea5a13a78b9e69eeffeee573.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d80efc1bcff45f70d2caffee42a3219a.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_8a973f9b491bfd3b29c03f8d44de283f.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_57cfd331b328a6ee00bde0fefd699134.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_4f16b2ddd49683681f094e7bb37620e7.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_6118c90cb464a91dad023d8d2ab12dad.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_320f51e402dfc1bfc12966352668b2cb.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_9f3ba6a0cf7dd64b4081cb3b98afac9e.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_54b3a6f65ab2727e366459d0078e6501.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_9aa6aa6d48fe871eec3c549cec07f218.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_5fa0b3892240732fce4470b4e175bcb3.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d0a5adde79073e95ce47a9b8b7f61074.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_3f36307b90f24fcdb3a1ccb91f7f77f1.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d7240fbde6cce48b3ce95106bf21ae70.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_90d849ab7b2ca0f33477ff6c1772482c.jpg',
'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_5ba6e86257b2fe65059ed678ccc04f7f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_e56e8b5cea5a13a78b9e69eeffeee573.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d80efc1bcff45f70d2caffee42a3219a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_8a973f9b491bfd3b29c03f8d44de283f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_57cfd331b328a6ee00bde0fefd699134.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_4f16b2ddd49683681f094e7bb37620e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_6118c90cb464a91dad023d8d2ab12dad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_320f51e402dfc1bfc12966352668b2cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_9f3ba6a0cf7dd64b4081cb3b98afac9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_54b3a6f65ab2727e366459d0078e6501.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_9aa6aa6d48fe871eec3c549cec07f218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_5fa0b3892240732fce4470b4e175bcb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d0a5adde79073e95ce47a9b8b7f61074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_3f36307b90f24fcdb3a1ccb91f7f77f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_d7240fbde6cce48b3ce95106bf21ae70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_90d849ab7b2ca0f33477ff6c1772482c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd51f35-3750-5851-a829-3b78564f2190/3fd51f35-3750-5851-a829-3b78564f2190_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a0/1ca0766dea713f5a4ee006548f595075/pa/FD44539_5ba6e86257b2fe65059ed678ccc04f7f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2022}
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD44539%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Saving data for FD44539: {'created_time': 1769666439.481548, 'last_price_update_time': 1769666439.481559, 'auction_closing_time': 1769705040.0}
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FD44539') HTTP/1.1" 204 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: BY48993
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY48993%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for BY48993: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: CZ20129
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ20129%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for CZ20129: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: WX23991
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX23991%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for WX23991: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: LY33885
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY33885%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for LY33885: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: XS30477
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS30477%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for XS30477: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: EG37952
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG37952%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for EG37952: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: BF10969
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF10969%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for BF10969: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: UA78056
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA78056%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for UA78056: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: WL01160
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL01160%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for WL01160: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: KJ07748
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ07748%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for KJ07748: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: GR14837
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR14837%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for GR14837: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: GW13583
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW13583%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for GW13583: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: ZS15160
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS15160%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for ZS15160: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: ZY55990
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY55990%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for ZY55990: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: WE66422
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE66422%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for WE66422: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: HJ32619
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ32619%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for HJ32619: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: WW33546
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW33546%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for WW33546: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: VU10076
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU10076%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for VU10076: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: ZC42909
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC42909%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for ZC42909: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: UF82810
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF82810%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for UF82810: 2
2026-01-29 06:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN21323> (referer: https://www.auto1.com/v1/car-details-view/GN21323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH34760> (referer: https://www.auto1.com/v1/car-details-view/GH34760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC73703> (referer: https://www.auto1.com/v1/car-details-view/FC73703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP09349> (referer: https://www.auto1.com/v1/car-details-view/EP09349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: FF54775
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF54775%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for FF54775: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: HA44926
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA44926%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for HA44926: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: CS90007
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS90007%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for CS90007: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: GF32927
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF32927%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for GF32927: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: TP05677
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP05677%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for TP05677: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: YC43359
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43359%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [auto1.es] INFO: Scrape type for YC43359: 0
2026-01-29 06:00:39 [auto1.es] INFO: Found listing with ID: KD97455
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD97455%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for KD97455: 2
2026-01-29 06:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f43e05f-5eac-558e-80a6-feb09add77ea with identifier: UZ84215
2026-01-29 06:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f43e05f-5eac-558e-80a6-feb09add77ea with scrape type 1
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg not downloaded yet
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: LC08667
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC08667%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for LC08667: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: YR67530
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR67530%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for YR67530: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: YE57491
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE57491%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for YE57491: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: SH74673
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH74673%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for SH74673: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: VX73239
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX73239%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for VX73239: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: MY54875
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY54875%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for MY54875: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: EW49627
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW49627%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for EW49627: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: DP05914
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP05914%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for DP05914: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: VX84940
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX84940%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for VX84940: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: YN74172
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN74172%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for YN74172: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: AG11997
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG11997%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for AG11997: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: GX78930
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX78930%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for GX78930: 0
2026-01-29 06:00:40 [auto1.es] INFO: Found listing with ID: BW69115
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW69115%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Scrape type for BW69115: 0
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_3b20b19e3be600e186c4eb6cdca6f944.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3b20b19e3be600e186c4eb6cdca6f944.jpg not downloaded yet
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_18ac83ad756f5a1fb531ca61f01c4c20.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_18ac83ad756f5a1fb531ca61f01c4c20.jpg not downloaded yet
2026-01-29 06:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b86422e-c44c-5b64-a24c-1a5990d006b2 with identifier: GN21323
2026-01-29 06:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b86422e-c44c-5b64-a24c-1a5990d006b2 with scrape type 2
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b86422e-c44c-5b64-a24c-1a5990d006b2 with scrape type 2
2026-01-29 06:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b86422e-c44c-5b64-a24c-1a5990d006b2, identifier: GN21323
2026-01-29 06:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f7edd6-8afa-56b7-9cb6-fda58367b36e with identifier: GH34760
2026-01-29 06:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e with scrape type 1
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_744e9f6eacb8c7caf65592b86456c218.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_744e9f6eacb8c7caf65592b86456c218.jpg not downloaded yet
2026-01-29 06:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22af5591-0d0a-5812-a652-fcdff6cbc873 with identifier: FC73703
2026-01-29 06:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22af5591-0d0a-5812-a652-fcdff6cbc873 with scrape type 2
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22af5591-0d0a-5812-a652-fcdff6cbc873 with scrape type 2
2026-01-29 06:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22af5591-0d0a-5812-a652-fcdff6cbc873, identifier: FC73703
2026-01-29 06:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd38d896-4f9e-5e4d-80d9-7e3b133d9595 with identifier: EP09349
2026-01-29 06:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595 with scrape type 1
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg not downloaded yet
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_8c8727bad5a3d97d358358411e62a8c1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_8c8727bad5a3d97d358358411e62a8c1.jpg not downloaded yet
2026-01-29 06:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b86422e-c44c-5b64-a24c-1a5990d006b2 with identifier: GN21323
2026-01-29 06:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b86422e-c44c-5b64-a24c-1a5990d006b2 with identifier: GN21323
2026-01-29 06:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2026-01-29 06:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0b86422e-c44c-5b64-a24c-1a5990d006b2 spider: auto1.es
2026-01-29 06:00:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0b86422e-c44c-5b64-a24c-1a5990d006b2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.3L',
'engine_horse_power': 130,
'expiration_date': '2026-01-29T16:06:55Z',
'fuel_type': 'diesel',
'id': '0b86422e-c44c-5b64-a24c-1a5990d006b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN21323',
'listing': 'auction',
'location': 'ES',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 184477,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-27',
'seats_number': 3,
'seller_name': None,
'title': 'Fiat Ducato 2.3 JTD 130',
'transmission': 'manual',
'trim': '130',
'year': 2019}
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN21323%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.es] INFO: Saving data for GN21323: {'auction_closing_time': 1769702815.0, 'created_time': 1769188157.474713, 'last_price_update_time': 1769666440.908771}
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GN21323') HTTP/1.1" 204 0
2026-01-29 06:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22af5591-0d0a-5812-a652-fcdff6cbc873 with identifier: FC73703
2026-01-29 06:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22af5591-0d0a-5812-a652-fcdff6cbc873 with identifier: FC73703
2026-01-29 06:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-29 06:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 22af5591-0d0a-5812-a652-fcdff6cbc873 spider: auto1.es
2026-01-29 06:00:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 22af5591-0d0a-5812-a652-fcdff6cbc873 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:31:02Z',
'fuel_type': 'diesel',
'id': '22af5591-0d0a-5812-a652-fcdff6cbc873',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC73703',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 149167,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
'transmission': 'manual',
'trim': 'Active L1',
'year': 2021}
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC73703%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [auto1.es] INFO: Saving data for FC73703: {'auction_closing_time': 1769704262.0, 'created_time': 1767805445.227377, 'last_price_update_time': 1769666441.245957}
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC73703') HTTP/1.1" 204 0
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_3a603de5a76010fbbb73f5a3e94bea3e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_3a603de5a76010fbbb73f5a3e94bea3e.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_b387cf421b00484850ff5d476e90501e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_b387cf421b00484850ff5d476e90501e.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_ffa6fe372ca0232edeb2379ac7c889cf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_ffa6fe372ca0232edeb2379ac7c889cf.jpg not downloaded yet
2026-01-29 06:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK09495> (referer: https://www.auto1.com/v1/car-details-view/ZK09495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD60127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR81634> (referer: https://www.auto1.com/v1/car-details-view/GR81634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_98d3d1d6f075901ea00f94f6bae29f86.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_98d3d1d6f075901ea00f94f6bae29f86.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_7b1f7c526a52751f55f7295235cb438e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_7b1f7c526a52751f55f7295235cb438e.jpg not downloaded yet
2026-01-29 06:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN86543> (referer: https://www.auto1.com/v1/car-details-view/UN86543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_23c79689df8a3c4a857d12658a0b727f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_23c79689df8a3c4a857d12658a0b727f.jpg not downloaded yet
2026-01-29 06:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_5a4cdd9c8d39d22adc65b0c15d622e10.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5a4cdd9c8d39d22adc65b0c15d622e10.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_70c52767ec4b8e35a105ded3ceaf6c46.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_70c52767ec4b8e35a105ded3ceaf6c46.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_48e2618745fd618a74f1a16a4ada7990.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_48e2618745fd618a74f1a16a4ada7990.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_78f109ac034c2936f92a88236cf4b490.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_78f109ac034c2936f92a88236cf4b490.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_8f960b891e2a8043eaa2601c93f0e354.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_8f960b891e2a8043eaa2601c93f0e354.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_af05208a998f1aaa35c7e2dfab1a0141.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_af05208a998f1aaa35c7e2dfab1a0141.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_e8d95451e16f31428e1ba1fb95aae26f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_e8d95451e16f31428e1ba1fb95aae26f.jpg not downloaded yet
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_fc2efb8e7c9ff6b5ea863398b73fadcb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_fc2efb8e7c9ff6b5ea863398b73fadcb.jpg not downloaded yet
2026-01-29 06:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaabcb68-2605-5c06-9b67-0af724510263 with identifier: ZK09495
2026-01-29 06:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaabcb68-2605-5c06-9b67-0af724510263 with scrape type 1
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_cb73629535e301fdd261e6321e109085.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_cb73629535e301fdd261e6321e109085.jpg not downloaded yet
2026-01-29 06:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59ac1c95-e6f8-5acb-83aa-7089a04f2453 with identifier: GR81634
2026-01-29 06:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59ac1c95-e6f8-5acb-83aa-7089a04f2453 with scrape type 2
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59ac1c95-e6f8-5acb-83aa-7089a04f2453 with scrape type 2
2026-01-29 06:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 59ac1c95-e6f8-5acb-83aa-7089a04f2453, identifier: GR81634
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_3a9f2722a759c78617127b563167738f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3a9f2722a759c78617127b563167738f.jpg not downloaded yet
2026-01-29 06:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 59ac1c95-e6f8-5acb-83aa-7089a04f2453 with identifier: GR81634
2026-01-29 06:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 59ac1c95-e6f8-5acb-83aa-7089a04f2453 with identifier: GR81634
2026-01-29 06:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 59ac1c95-e6f8-5acb-83aa-7089a04f2453 with identifier: GR81634 to the API
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR81634>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-01-29T16:32:56Z',
'fuel_type': 'petrol',
'id': '59ac1c95-e6f8-5acb-83aa-7089a04f2453',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR81634',
'listing': 'auction',
'location': 'ES, Granyanella',
'make': 'BMW',
'model': '1er',
'odometer': 81609,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR81634%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [auto1.es] INFO: Saving data for GR81634: {'auction_closing_time': 1769704376.0, 'created_time': 1769003373.726111, 'last_price_update_time': 1769666442.096446}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR81634') HTTP/1.1" 204 0
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_45915de440ab4f691359bec926360266.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_45915de440ab4f691359bec926360266.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_6e7b6bda639bb1b95187ea205e32a004.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6e7b6bda639bb1b95187ea205e32a004.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_241289b41181159eea2c8ca6bc56573d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_241289b41181159eea2c8ca6bc56573d.jpg not downloaded yet
2026-01-29 06:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8624e71-75e6-540e-9096-9d0f2ed9cbc5 with identifier: UN86543
2026-01-29 06:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8624e71-75e6-540e-9096-9d0f2ed9cbc5 with scrape type 2
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8624e71-75e6-540e-9096-9d0f2ed9cbc5 with scrape type 2
2026-01-29 06:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f8624e71-75e6-540e-9096-9d0f2ed9cbc5, identifier: UN86543
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_e6de76b6a4deccafed9e3947938c572e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_e6de76b6a4deccafed9e3947938c572e.jpg not downloaded yet
2026-01-29 06:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f8624e71-75e6-540e-9096-9d0f2ed9cbc5 with identifier: UN86543
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f8624e71-75e6-540e-9096-9d0f2ed9cbc5 with identifier: UN86543
2026-01-29 06:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f8624e71-75e6-540e-9096-9d0f2ed9cbc5 with identifier: UN86543 to the API
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN86543>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:24:45Z',
'fuel_type': 'petrol',
'id': 'f8624e71-75e6-540e-9096-9d0f2ed9cbc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN86543',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Seat',
'model': 'Arona',
'odometer': 79321,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-12',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN86543%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [auto1.es] INFO: Saving data for UN86543: {'auction_closing_time': 1769703885.0, 'created_time': 1764090413.036155, 'last_price_update_time': 1769666442.783883}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UN86543') HTTP/1.1" 204 0
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_150d0bdf0a46973fbf38b9553e539025.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_150d0bdf0a46973fbf38b9553e539025.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_d8f16cdc52da651d564122c1b6f21612.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_d8f16cdc52da651d564122c1b6f21612.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_9fe4646a3b47e5190e8f96c74f5282dc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9fe4646a3b47e5190e8f96c74f5282dc.jpg not downloaded yet
2026-01-29 06:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT15505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM34315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY34007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN46229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_96cbbae3f72cb267afa4fa98f01d731b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96cbbae3f72cb267afa4fa98f01d731b.jpg not downloaded yet
2026-01-29 06:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_6b6e52297e8023e94f377f20430c052a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_6b6e52297e8023e94f377f20430c052a.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_aeb397e1dba52040cca663cbfb091ee7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_aeb397e1dba52040cca663cbfb091ee7.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_9b88682794448fb92a7d9eb7866f198a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9b88682794448fb92a7d9eb7866f198a.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_96481889c9ba2bf778a7229be2d4baf1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96481889c9ba2bf778a7229be2d4baf1.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_7b29414946f977b6766fcb1c0a931c28.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7b29414946f977b6766fcb1c0a931c28.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_1e915284cfba9060c5ddf59cced178d9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1e915284cfba9060c5ddf59cced178d9.jpg not downloaded yet
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_b97ee0ebe486a78f4cb9a8552fce1db4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b97ee0ebe486a78f4cb9a8552fce1db4.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_316b464883014dbf95838a050df400c5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_316b464883014dbf95838a050df400c5.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_9aac3bf51f67fd78d4e90fa4b8f5c41c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_9aac3bf51f67fd78d4e90fa4b8f5c41c.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_9ba65afb9b130dc1c6a37f73058faaed.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_9ba65afb9b130dc1c6a37f73058faaed.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_785d44c48dfdc954a99ece5364a25ac4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_785d44c48dfdc954a99ece5364a25ac4.jpg not downloaded yet
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_b387cf421b00484850ff5d476e90501e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_3a603de5a76010fbbb73f5a3e94bea3e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_4453cedcca4a0317d3f63707cb1eb1ce.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_4453cedcca4a0317d3f63707cb1eb1ce.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_290b7bc2b7f8103efb94842874ecbbed.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_290b7bc2b7f8103efb94842874ecbbed.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_2886d05e21f285fd4f006cce715f4a92.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_2886d05e21f285fd4f006cce715f4a92.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_3ad9cdc60bb4a006844927d31221a4c7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_3ad9cdc60bb4a006844927d31221a4c7.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_1f4bf81d9e71009ab6fae52164c8faae.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_1f4bf81d9e71009ab6fae52164c8faae.jpg not downloaded yet
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_8c8727bad5a3d97d358358411e62a8c1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_7cadf0bb6125465ef7dd6fa38e69854b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7cadf0bb6125465ef7dd6fa38e69854b.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_518b307fb9474571712e86f4d9a554ec.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_518b307fb9474571712e86f4d9a554ec.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_6fc3228eca411e5137677af9143e61d1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_6fc3228eca411e5137677af9143e61d1.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_45e2a6f8d688cf555aca78eabe23e882.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_45e2a6f8d688cf555aca78eabe23e882.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_15fb2b6605afcf75b6871d41de74d9a9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_15fb2b6605afcf75b6871d41de74d9a9.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_a242d93ef111e6aa5e07ef19d03417e1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_a242d93ef111e6aa5e07ef19d03417e1.jpg not downloaded yet
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_544b452a801129180c2698d06c5497ee.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_544b452a801129180c2698d06c5497ee.jpg not downloaded yet
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1b7650>
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_b387cf421b00484850ff5d476e90501e.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_b387cf421b00484850ff5d476e90501e.jpg saved to cache
2026-01-29 06:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2c5cd0>
2026-01-29 06:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_3a603de5a76010fbbb73f5a3e94bea3e.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_3a603de5a76010fbbb73f5a3e94bea3e.jpg saved to cache
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b97ee0ebe486a78f4cb9a8552fce1db4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_13da87eed39b60dd8bd7d4ae53a8650e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_13da87eed39b60dd8bd7d4ae53a8650e.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_1c27720b53c20084031c59de7676ba4e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1c27720b53c20084031c59de7676ba4e.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_2f8a3e3ce435799afb479d0fe4870a5e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_2f8a3e3ce435799afb479d0fe4870a5e.jpg not downloaded yet
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_3ad9cdc60bb4a006844927d31221a4c7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_316b464883014dbf95838a050df400c5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS10897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ69779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM24266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_5d97ddbba39b447ca779ab29962ee6e3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5d97ddbba39b447ca779ab29962ee6e3.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_21e5f7b4a8b891e424edf8631aa4ecca.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_21e5f7b4a8b891e424edf8631aa4ecca.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_f74563499f2a4730dd30ab82a1472f38.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_f74563499f2a4730dd30ab82a1472f38.jpg not downloaded yet
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c189110>
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_8c8727bad5a3d97d358358411e62a8c1.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_8c8727bad5a3d97d358358411e62a8c1.jpg saved to cache
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_241289b41181159eea2c8ca6bc56573d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_45915de440ab4f691359bec926360266.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6e7b6bda639bb1b95187ea205e32a004.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_97aa3d9eecd4d580bc125030bc1e2020.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_97aa3d9eecd4d580bc125030bc1e2020.jpg not downloaded yet
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_544b452a801129180c2698d06c5497ee.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_e6de76b6a4deccafed9e3947938c572e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_77454f33aa87e1ba2300ce19500a6ae6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_77454f33aa87e1ba2300ce19500a6ae6.jpg not downloaded yet
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2b9290>
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_b97ee0ebe486a78f4cb9a8552fce1db4.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b97ee0ebe486a78f4cb9a8552fce1db4.jpg saved to cache
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c3ea310>
2026-01-29 06:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_3ad9cdc60bb4a006844927d31221a4c7.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_3ad9cdc60bb4a006844927d31221a4c7.jpg saved to cache
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e62d90>
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_316b464883014dbf95838a050df400c5.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_316b464883014dbf95838a050df400c5.jpg saved to cache
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:45 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_15fb2b6605afcf75b6871d41de74d9a9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_171487239b9c489a3c437a6c6edbaadf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_171487239b9c489a3c437a6c6edbaadf.jpg not downloaded yet
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_13da87eed39b60dd8bd7d4ae53a8650e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_45e2a6f8d688cf555aca78eabe23e882.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: TN28829
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN28829%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for TN28829: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: GB30495
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB30495%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for GB30495: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: GM35418
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM35418%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for GM35418: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: SX70462
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX70462%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for SX70462: 2
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_2f8a3e3ce435799afb479d0fe4870a5e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_f74563499f2a4730dd30ab82a1472f38.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_a242d93ef111e6aa5e07ef19d03417e1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1c27720b53c20084031c59de7676ba4e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_b8e17376298abca9cb01344ab4fe4c46.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b8e17376298abca9cb01344ab4fe4c46.jpg not downloaded yet
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF82810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP61591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM34040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB75333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: US71601
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US71601%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for US71601: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: ZG79943
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG79943%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for ZG79943: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: MG33728
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG33728%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for MG33728: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: FA30255
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA30255%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for FA30255: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: LL32734
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL32734%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for LL32734: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: HW10674
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW10674%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for HW10674: 0
2026-01-29 06:00:45 [auto1.es] INFO: Found listing with ID: DP18472
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP18472%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.es] INFO: Scrape type for DP18472: 2
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1b4c10>
2026-01-29 06:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_241289b41181159eea2c8ca6bc56573d.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_241289b41181159eea2c8ca6bc56573d.jpg saved to cache
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e10690>
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_45915de440ab4f691359bec926360266.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_45915de440ab4f691359bec926360266.jpg saved to cache
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e12890>
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_6e7b6bda639bb1b95187ea205e32a004.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6e7b6bda639bb1b95187ea205e32a004.jpg saved to cache
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1afc50>
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_544b452a801129180c2698d06c5497ee.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_544b452a801129180c2698d06c5497ee.jpg saved to cache
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c128b90>
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_e6de76b6a4deccafed9e3947938c572e.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_e6de76b6a4deccafed9e3947938c572e.jpg saved to cache
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_48faaf9c4106d368c5bc902839640959.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_48faaf9c4106d368c5bc902839640959.jpg not downloaded yet
2026-01-29 06:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_518b307fb9474571712e86f4d9a554ec.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: WX94287
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX94287%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for WX94287: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: UC47290
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC47290%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for UC47290: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: UG40177
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG40177%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for UG40177: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: UT03911
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT03911%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for UT03911: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: VZ14488
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14488%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for VZ14488: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: VK95324
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK95324%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for VK95324: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: GP22189
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP22189%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for GP22189: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: FY93718
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY93718%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for FY93718: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: LW34581
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW34581%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for LW34581: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: FM29540
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM29540%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for FM29540: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: PL95593
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL95593%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for PL95593: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: GY60731
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY60731%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for GY60731: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: ZK05634
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK05634%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for ZK05634: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: NW59290
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW59290%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for NW59290: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: UT89207
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT89207%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for UT89207: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: KR57898
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR57898%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for KR57898: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: RD05990
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD05990%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for RD05990: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: KP04085
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP04085%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for KP04085: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: SF23553
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF23553%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for SF23553: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: HU36118
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU36118%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for HU36118: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: FR43336
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR43336%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for FR43336: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: DZ72850
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ72850%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for DZ72850: 0
2026-01-29 06:00:47 [auto1.es] INFO: Found listing with ID: SF93230
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF93230%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [auto1.es] INFO: Scrape type for SF93230: 2
2026-01-29 06:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c31dc50>
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_15fb2b6605afcf75b6871d41de74d9a9.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_15fb2b6605afcf75b6871d41de74d9a9.jpg saved to cache
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c147750>
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_13da87eed39b60dd8bd7d4ae53a8650e.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_13da87eed39b60dd8bd7d4ae53a8650e.jpg saved to cache
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c19c5d0>
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_45e2a6f8d688cf555aca78eabe23e882.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_45e2a6f8d688cf555aca78eabe23e882.jpg saved to cache
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5d97ddbba39b447ca779ab29962ee6e3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_6fc3228eca411e5137677af9143e61d1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_21e5f7b4a8b891e424edf8631aa4ecca.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_171487239b9c489a3c437a6c6edbaadf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:48 [auto1.es] INFO: Found listing with ID: KV73923
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV73923%27 HTTP/1.1" 200 None
2026-01-29 06:00:48 [auto1.es] INFO: Scrape type for KV73923: 0
2026-01-29 06:00:48 [auto1.es] INFO: Found listing with ID: ZR54852
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR54852%27 HTTP/1.1" 200 None
2026-01-29 06:00:48 [auto1.es] INFO: Scrape type for ZR54852: 0
2026-01-29 06:00:48 [auto1.es] INFO: Found listing with ID: GC05053
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC05053%27 HTTP/1.1" 200 None
2026-01-29 06:00:49 [auto1.es] INFO: Scrape type for GC05053: 0
2026-01-29 06:00:49 [auto1.es] INFO: Found listing with ID: VJ96462
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ96462%27 HTTP/1.1" 200 None
2026-01-29 06:00:49 [auto1.es] INFO: Scrape type for VJ96462: 0
2026-01-29 06:00:49 [auto1.es] INFO: Found listing with ID: PV27185
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV27185%27 HTTP/1.1" 200 None
2026-01-29 06:00:49 [auto1.es] INFO: Scrape type for PV27185: 0
2026-01-29 06:00:49 [auto1.es] INFO: Found listing with ID: YB91679
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB91679%27 HTTP/1.1" 200 None
2026-01-29 06:00:49 [auto1.es] INFO: Scrape type for YB91679: 2
2026-01-29 06:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d3fb50>
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_2f8a3e3ce435799afb479d0fe4870a5e.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_2f8a3e3ce435799afb479d0fe4870a5e.jpg saved to cache
2026-01-29 06:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d2ebd0>
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_f74563499f2a4730dd30ab82a1472f38.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_f74563499f2a4730dd30ab82a1472f38.jpg saved to cache
2026-01-29 06:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c3c36d0>
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_a242d93ef111e6aa5e07ef19d03417e1.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_a242d93ef111e6aa5e07ef19d03417e1.jpg saved to cache
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d49650>
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_1c27720b53c20084031c59de7676ba4e.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1c27720b53c20084031c59de7676ba4e.jpg saved to cache
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_77454f33aa87e1ba2300ce19500a6ae6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_97aa3d9eecd4d580bc125030bc1e2020.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c318b10>
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_518b307fb9474571712e86f4d9a554ec.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_518b307fb9474571712e86f4d9a554ec.jpg saved to cache
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7cadf0bb6125465ef7dd6fa38e69854b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_2886d05e21f285fd4f006cce715f4a92.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b8e17376298abca9cb01344ab4fe4c46.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_1f4bf81d9e71009ab6fae52164c8faae.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2192d0>
2026-01-29 06:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_5d97ddbba39b447ca779ab29962ee6e3.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5d97ddbba39b447ca779ab29962ee6e3.jpg saved to cache
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c22ded0>
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_6fc3228eca411e5137677af9143e61d1.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_6fc3228eca411e5137677af9143e61d1.jpg saved to cache
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c31d8d0>
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_21e5f7b4a8b891e424edf8631aa4ecca.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_21e5f7b4a8b891e424edf8631aa4ecca.jpg saved to cache
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f06577d6190>
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_171487239b9c489a3c437a6c6edbaadf.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_171487239b9c489a3c437a6c6edbaadf.jpg saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_48faaf9c4106d368c5bc902839640959.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d496d0>
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_77454f33aa87e1ba2300ce19500a6ae6.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_77454f33aa87e1ba2300ce19500a6ae6.jpg saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c317d50>
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_97aa3d9eecd4d580bc125030bc1e2020.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_97aa3d9eecd4d580bc125030bc1e2020.jpg saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_290b7bc2b7f8103efb94842874ecbbed.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ69779> (referer: https://www.auto1.com/v1/car-details-view/BJ69779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM24266> (referer: https://www.auto1.com/v1/car-details-view/EM24266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS10897> (referer: https://www.auto1.com/v1/car-details-view/NS10897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX70462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655da5f10>
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_7cadf0bb6125465ef7dd6fa38e69854b.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7cadf0bb6125465ef7dd6fa38e69854b.jpg saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d70dd0>
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_2886d05e21f285fd4f006cce715f4a92.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_2886d05e21f285fd4f006cce715f4a92.jpg saved to cache
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f06577b9d50>
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_b8e17376298abca9cb01344ab4fe4c46.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b8e17376298abca9cb01344ab4fe4c46.jpg saved to cache
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d52e50>
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_1f4bf81d9e71009ab6fae52164c8faae.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_1f4bf81d9e71009ab6fae52164c8faae.jpg saved to cache
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065774d0d0>
2026-01-29 06:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_48faaf9c4106d368c5bc902839640959.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_48faaf9c4106d368c5bc902839640959.jpg saved to cache
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e60e10>
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_290b7bc2b7f8103efb94842874ecbbed.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_290b7bc2b7f8103efb94842874ecbbed.jpg saved to cache
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f68d66-eb22-5e1a-aeea-aefcf2287a68 with identifier: BJ69779
2026-01-29 06:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f68d66-eb22-5e1a-aeea-aefcf2287a68 with scrape type 1
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 36f68d66-eb22-5e1a-aeea-aefcf2287a68
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_57e68cb3938621956095163984741efb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_57e68cb3938621956095163984741efb.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_d342940c050d4fc4c96a2c47e400b499.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_d342940c050d4fc4c96a2c47e400b499.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_a644cdf1f64f3d702733d32a4cf1cdb6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_a644cdf1f64f3d702733d32a4cf1cdb6.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_94d275cfe903858d17913c1144b8ded6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_94d275cfe903858d17913c1144b8ded6.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_f89232285cfa2e17e09aae24ecabe72a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_f89232285cfa2e17e09aae24ecabe72a.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_a621e72f36474960fa2947f9f08c4d86.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_a621e72f36474960fa2947f9f08c4d86.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_ce180f73148365aefd31b0bdab1c730c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ce180f73148365aefd31b0bdab1c730c.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_f60d8d71a6a3df7530c5d5f7a641387e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_f60d8d71a6a3df7530c5d5f7a641387e.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_7b09eb44da901e77b6b7717cc128bfe9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_7b09eb44da901e77b6b7717cc128bfe9.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_5438d1574d2d4344db3086bfc19be623.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5438d1574d2d4344db3086bfc19be623.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_ff962db9e0a9f06b608fea801a878feb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ff962db9e0a9f06b608fea801a878feb.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_5268d752f548a6064a0e1c7a2f16c754.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5268d752f548a6064a0e1c7a2f16c754.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_5ed1518a739e0e9ef75e02baec42f1d8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5ed1518a739e0e9ef75e02baec42f1d8.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_4c57f66c7790fb996037b4c87932b16e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_4c57f66c7790fb996037b4c87932b16e.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_ad0178d305c9c011d81c1a826f181c9e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ad0178d305c9c011d81c1a826f181c9e.jpg already downloaded
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F900893a963f59ae952112a0e3be163f2%252Fpa%252FBJ69779_59a0bdca0f7a7f8fdcc7bba321c3327a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_59a0bdca0f7a7f8fdcc7bba321c3327a.jpg already downloaded
2026-01-29 06:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36f68d66-eb22-5e1a-aeea-aefcf2287a68, identifier: BJ69779
2026-01-29 06:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5a7f1f1-9ccb-5c73-b52a-efde2689d080 with identifier: EM24266
2026-01-29 06:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5a7f1f1-9ccb-5c73-b52a-efde2689d080 with scrape type 1
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a5a7f1f1-9ccb-5c73-b52a-efde2689d080
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_a179c11eb1a36579e44188e9b2b079b2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_a179c11eb1a36579e44188e9b2b079b2.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_ad692dbe8ad28cf85b6b1c8f3fb3c73a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_ad692dbe8ad28cf85b6b1c8f3fb3c73a.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_3adc1233efcb3f203509a3458311da28.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_3adc1233efcb3f203509a3458311da28.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_16bc2c1c96e5e9dae6d228c36f484604.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_16bc2c1c96e5e9dae6d228c36f484604.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_b68025aa0f2cb764b93e1cb77144c46e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_b68025aa0f2cb764b93e1cb77144c46e.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_f46c677f1a35a0154bc1138556b7f10f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_f46c677f1a35a0154bc1138556b7f10f.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_2162c2b36911c5e0ea31aff124e0e71c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_2162c2b36911c5e0ea31aff124e0e71c.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_3b47b7e45fc60f35847f2eefb5096b66.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_3b47b7e45fc60f35847f2eefb5096b66.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_a89c8c17daf32ed600abe9e0643536fe.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_a89c8c17daf32ed600abe9e0643536fe.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_eb9fd1bdbee8311c575ee1e12ea41bde.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_eb9fd1bdbee8311c575ee1e12ea41bde.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_98fcb76ee09f6a77e4329386062a1d46.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_98fcb76ee09f6a77e4329386062a1d46.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_aba7acc5f2494edf9e85034b3acca277.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_aba7acc5f2494edf9e85034b3acca277.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_7838041b56cbdc0833982539acd34191.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_7838041b56cbdc0833982539acd34191.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_93e4432264117519e9ad7bec70342207.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_93e4432264117519e9ad7bec70342207.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_82417175b3383eeba858b1ff6b346581.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_82417175b3383eeba858b1ff6b346581.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F9e%252F4f9e9dbfe2141425ba6d4c2417242dc7%252Fpa%252FEM24266_d79301e2dabb0fe016a7791241821ac4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_d79301e2dabb0fe016a7791241821ac4.jpg already downloaded
2026-01-29 06:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a5a7f1f1-9ccb-5c73-b52a-efde2689d080, identifier: EM24266
2026-01-29 06:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e8de36-f6f3-524e-8384-829abf8b5baf with identifier: NS10897
2026-01-29 06:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e8de36-f6f3-524e-8384-829abf8b5baf with scrape type 2
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e8de36-f6f3-524e-8384-829abf8b5baf with scrape type 2
2026-01-29 06:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96e8de36-f6f3-524e-8384-829abf8b5baf, identifier: NS10897
2026-01-29 06:00:55 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36f68d66-eb22-5e1a-aeea-aefcf2287a68 with identifier: BJ69779
2026-01-29 06:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36f68d66-eb22-5e1a-aeea-aefcf2287a68 with identifier: BJ69779
2026-01-29 06:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 36f68d66-eb22-5e1a-aeea-aefcf2287a68 spider: auto1.es
2026-01-29 06:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 36f68d66-eb22-5e1a-aeea-aefcf2287a68 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:53:09Z',
'fuel_type': 'diesel',
'id': '36f68d66-eb22-5e1a-aeea-aefcf2287a68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ69779',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 141668,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_57e68cb3938621956095163984741efb.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_d342940c050d4fc4c96a2c47e400b499.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_a644cdf1f64f3d702733d32a4cf1cdb6.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_94d275cfe903858d17913c1144b8ded6.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_f89232285cfa2e17e09aae24ecabe72a.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_a621e72f36474960fa2947f9f08c4d86.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ce180f73148365aefd31b0bdab1c730c.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_f60d8d71a6a3df7530c5d5f7a641387e.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_7b09eb44da901e77b6b7717cc128bfe9.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5438d1574d2d4344db3086bfc19be623.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ff962db9e0a9f06b608fea801a878feb.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5268d752f548a6064a0e1c7a2f16c754.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5ed1518a739e0e9ef75e02baec42f1d8.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_4c57f66c7790fb996037b4c87932b16e.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ad0178d305c9c011d81c1a826f181c9e.jpg',
'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_59a0bdca0f7a7f8fdcc7bba321c3327a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_57e68cb3938621956095163984741efb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_d342940c050d4fc4c96a2c47e400b499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_a644cdf1f64f3d702733d32a4cf1cdb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_94d275cfe903858d17913c1144b8ded6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_f89232285cfa2e17e09aae24ecabe72a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_a621e72f36474960fa2947f9f08c4d86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ce180f73148365aefd31b0bdab1c730c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_f60d8d71a6a3df7530c5d5f7a641387e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_7b09eb44da901e77b6b7717cc128bfe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5438d1574d2d4344db3086bfc19be623.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ff962db9e0a9f06b608fea801a878feb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5268d752f548a6064a0e1c7a2f16c754.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_5ed1518a739e0e9ef75e02baec42f1d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_4c57f66c7790fb996037b4c87932b16e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_ad0178d305c9c011d81c1a826f181c9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f68d66-eb22-5e1a-aeea-aefcf2287a68/36f68d66-eb22-5e1a-aeea-aefcf2287a68_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/08/900893a963f59ae952112a0e3be163f2/pa/BJ69779_59a0bdca0f7a7f8fdcc7bba321c3327a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
'transmission': 'manual',
'trim': 'Shine M',
'year': 2019}
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ69779%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [auto1.es] INFO: Saving data for BJ69779: {'created_time': 1769666456.093218, 'last_price_update_time': 1769666456.093227, 'auction_closing_time': 1769705589.0}
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BJ69779') HTTP/1.1" 204 0
2026-01-29 06:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a5a7f1f1-9ccb-5c73-b52a-efde2689d080 with identifier: EM24266
2026-01-29 06:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a5a7f1f1-9ccb-5c73-b52a-efde2689d080 with identifier: EM24266
2026-01-29 06:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a5a7f1f1-9ccb-5c73-b52a-efde2689d080 with identifier: EM24266 to the API
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM24266>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-01-29T16:12:15Z',
'fuel_type': 'diesel',
'id': 'a5a7f1f1-9ccb-5c73-b52a-efde2689d080',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM24266',
'listing': 'auction',
'location': 'ES, Aldaya',
'make': 'Audi',
'model': 'Q5',
'odometer': 76546,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_a179c11eb1a36579e44188e9b2b079b2.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_ad692dbe8ad28cf85b6b1c8f3fb3c73a.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_3adc1233efcb3f203509a3458311da28.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_16bc2c1c96e5e9dae6d228c36f484604.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_b68025aa0f2cb764b93e1cb77144c46e.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_f46c677f1a35a0154bc1138556b7f10f.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_2162c2b36911c5e0ea31aff124e0e71c.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_3b47b7e45fc60f35847f2eefb5096b66.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_a89c8c17daf32ed600abe9e0643536fe.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_eb9fd1bdbee8311c575ee1e12ea41bde.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_98fcb76ee09f6a77e4329386062a1d46.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_aba7acc5f2494edf9e85034b3acca277.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_7838041b56cbdc0833982539acd34191.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_93e4432264117519e9ad7bec70342207.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_82417175b3383eeba858b1ff6b346581.jpg',
'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_d79301e2dabb0fe016a7791241821ac4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_a179c11eb1a36579e44188e9b2b079b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_ad692dbe8ad28cf85b6b1c8f3fb3c73a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_3adc1233efcb3f203509a3458311da28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_16bc2c1c96e5e9dae6d228c36f484604.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_b68025aa0f2cb764b93e1cb77144c46e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_f46c677f1a35a0154bc1138556b7f10f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_2162c2b36911c5e0ea31aff124e0e71c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_3b47b7e45fc60f35847f2eefb5096b66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_a89c8c17daf32ed600abe9e0643536fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_eb9fd1bdbee8311c575ee1e12ea41bde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_98fcb76ee09f6a77e4329386062a1d46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_aba7acc5f2494edf9e85034b3acca277.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_7838041b56cbdc0833982539acd34191.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_93e4432264117519e9ad7bec70342207.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_82417175b3383eeba858b1ff6b346581.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a7f1f1-9ccb-5c73-b52a-efde2689d080/a5a7f1f1-9ccb-5c73-b52a-efde2689d080_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/9e/4f9e9dbfe2141425ba6d4c2417242dc7/pa/EM24266_d79301e2dabb0fe016a7791241821ac4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 40 TDI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM24266%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [auto1.es] INFO: Saving data for EM24266: {'created_time': 1769666456.642474, 'last_price_update_time': 1769666456.64249, 'auction_closing_time': 1769703135.0}
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM24266') HTTP/1.1" 204 0
2026-01-29 06:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96e8de36-f6f3-524e-8384-829abf8b5baf with identifier: NS10897
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96e8de36-f6f3-524e-8384-829abf8b5baf with identifier: NS10897
2026-01-29 06:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 96e8de36-f6f3-524e-8384-829abf8b5baf with identifier: NS10897 to the API
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS10897>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': 'Rental',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 90,
'expiration_date': '2026-01-29T16:13:09Z',
'fuel_type': 'gas',
'id': '96e8de36-f6f3-524e-8384-829abf8b5baf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS10897',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'make': 'Seat',
'model': 'Arona',
'odometer': 63777,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TGI FR Edition',
'transmission': 'manual',
'trim': 'FR Edition',
'year': 2019}
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS10897%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Saving data for NS10897: {'auction_closing_time': 1769703189.0, 'created_time': 1767872435.54443, 'last_price_update_time': 1769666457.242023}
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NS10897') HTTP/1.1" 204 0
2026-01-29 06:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_9aac3bf51f67fd78d4e90fa4b8f5c41c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_4453cedcca4a0317d3f63707cb1eb1ce.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: BY34370
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY34370%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for BY34370: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: WH50900
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH50900%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for WH50900: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: PF19696
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF19696%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for PF19696: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: BE57160
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE57160%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for BE57160: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: AC14162
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC14162%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for AC14162: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: VF64596
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF64596%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for VF64596: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: UG66200
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG66200%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for UG66200: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: ZC94870
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC94870%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for ZC94870: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: BG39460
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG39460%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for BG39460: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: HG19376
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG19376%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for HG19376: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: GV47031
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV47031%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for GV47031: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: EY33498
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY33498%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for EY33498: 2
2026-01-29 06:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_9ba65afb9b130dc1c6a37f73058faaed.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_785d44c48dfdc954a99ece5364a25ac4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: MK11093
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK11093%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for MK11093: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: YW42428
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW42428%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for YW42428: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: RV86975
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV86975%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for RV86975: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: VY09840
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY09840%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for VY09840: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: XR21802
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR21802%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for XR21802: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: ZH60246
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH60246%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for ZH60246: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: DX14493
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX14493%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for DX14493: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: JS57551
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS57551%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for JS57551: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: SJ24506
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ24506%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for SJ24506: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: CN68851
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN68851%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for CN68851: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: JC52859
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC52859%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for JC52859: 2
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: WS46179
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS46179%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for WS46179: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: ZS76119
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS76119%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for ZS76119: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: NZ61100
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ61100%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for NZ61100: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: KK88353
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK88353%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for KK88353: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: AN83827
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN83827%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for AN83827: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: PD49428
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD49428%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for PD49428: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: PZ01712
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ01712%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for PZ01712: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: DV94358
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV94358%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for DV94358: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: DW14150
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW14150%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for DW14150: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: GJ77570
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ77570%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for GJ77570: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: MN19248
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN19248%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.es] INFO: Scrape type for MN19248: 0
2026-01-29 06:00:57 [auto1.es] INFO: Found listing with ID: UB02402
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB02402%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [auto1.es] INFO: Scrape type for UB02402: 0
2026-01-29 06:00:58 [auto1.es] INFO: Found listing with ID: WU73212
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU73212%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [auto1.es] INFO: Scrape type for WU73212: 0
2026-01-29 06:00:58 [auto1.es] INFO: Found listing with ID: CU12578
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU12578%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [auto1.es] INFO: Scrape type for CU12578: 0
2026-01-29 06:00:58 [auto1.es] INFO: Found listing with ID: WT01981
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT01981%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [auto1.es] INFO: Scrape type for WT01981: 0
2026-01-29 06:00:58 [auto1.es] INFO: Found listing with ID: FG99809
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [auto1.es] INFO: Scrape type for FG99809: 2
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d6cad0>
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_9aac3bf51f67fd78d4e90fa4b8f5c41c.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_9aac3bf51f67fd78d4e90fa4b8f5c41c.jpg saved to cache
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c35a90>
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_4453cedcca4a0317d3f63707cb1eb1ce.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_4453cedcca4a0317d3f63707cb1eb1ce.jpg saved to cache
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:00:58 [auto1.es] INFO: Found listing with ID: NS14217
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS14217%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [auto1.es] INFO: Scrape type for NS14217: 0
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1e915284cfba9060c5ddf59cced178d9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF93230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM34040> (referer: https://www.auto1.com/v1/car-details-view/ZM34040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN46229> (referer: https://www.auto1.com/v1/car-details-view/CN46229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF82810> (referer: https://www.auto1.com/v1/car-details-view/UF82810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY34007> (referer: https://www.auto1.com/v1/car-details-view/NY34007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655da3d50>
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_9ba65afb9b130dc1c6a37f73058faaed.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_9ba65afb9b130dc1c6a37f73058faaed.jpg saved to cache
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d472d0>
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_785d44c48dfdc954a99ece5364a25ac4.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_785d44c48dfdc954a99ece5364a25ac4.jpg saved to cache
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_ffa6fe372ca0232edeb2379ac7c889cf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB75333> (referer: https://www.auto1.com/v1/car-details-view/UB75333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP61591> (referer: https://www.auto1.com/v1/car-details-view/BP61591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065774d6d0>
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_1e915284cfba9060c5ddf59cced178d9.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1e915284cfba9060c5ddf59cced178d9.jpg saved to cache
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 with identifier: ZM34040
2026-01-29 06:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 with scrape type 1
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_29348458dfb3d426874e3b3c795e7172.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_29348458dfb3d426874e3b3c795e7172.jpg not downloaded yet
2026-01-29 06:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b554f9d2-5f38-5840-abf8-ae7e5c16c024 with identifier: CN46229
2026-01-29 06:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b554f9d2-5f38-5840-abf8-ae7e5c16c024 with scrape type 1
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b554f9d2-5f38-5840-abf8-ae7e5c16c024
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_4b8e7790d1a0f9160d69c9eb662d17c2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_4b8e7790d1a0f9160d69c9eb662d17c2.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_4586f0d8440f2248f44f2a94d5d4a20c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_4586f0d8440f2248f44f2a94d5d4a20c.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_a63a98d1cfce7be08fdfc2b0faca06c4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_a63a98d1cfce7be08fdfc2b0faca06c4.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_5fd1c386f866d29659c93586db77ebeb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_5fd1c386f866d29659c93586db77ebeb.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_e7a6cb4cc5ba447c11d98b01eb491d14.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_e7a6cb4cc5ba447c11d98b01eb491d14.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_08162ebefd9afc72e024190cf62f9e36.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_08162ebefd9afc72e024190cf62f9e36.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_829a7d6cd33703815d97e68cea654495.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_829a7d6cd33703815d97e68cea654495.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_6a8aab8d35ce2c22c060a461fe8c722f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_6a8aab8d35ce2c22c060a461fe8c722f.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_0ca20d6192d494efbce13d97f5c85999.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_0ca20d6192d494efbce13d97f5c85999.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_9f39030d3ddd973634719dc06e8f6cfe.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_9f39030d3ddd973634719dc06e8f6cfe.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_0195d82a1c5c411f9d268a7c1f8539a3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_0195d82a1c5c411f9d268a7c1f8539a3.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_6ebba57d4d62ce5bc44c52b1187218d4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_6ebba57d4d62ce5bc44c52b1187218d4.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_f8ff9fee1cb42e8d8dd11d46a05e0868.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_f8ff9fee1cb42e8d8dd11d46a05e0868.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_5273d79d93a68d45dfee58ddb232cd88.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_5273d79d93a68d45dfee58ddb232cd88.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_93ab9bb900b9fc7fc675a935508d1e54.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_93ab9bb900b9fc7fc675a935508d1e54.jpg already downloaded
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F13%252Fa5131120c87fc97e75c8aa373d237128%252Fpa%252FCN46229_610153484d59a8442af40e1bbaf5988c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_610153484d59a8442af40e1bbaf5988c.jpg already downloaded
2026-01-29 06:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b554f9d2-5f38-5840-abf8-ae7e5c16c024, identifier: CN46229
2026-01-29 06:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf79e054-b31f-546d-b4d8-0f025bb69f98 with identifier: UF82810
2026-01-29 06:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf79e054-b31f-546d-b4d8-0f025bb69f98 with scrape type 2
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf79e054-b31f-546d-b4d8-0f025bb69f98 with scrape type 2
2026-01-29 06:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf79e054-b31f-546d-b4d8-0f025bb69f98, identifier: UF82810
2026-01-29 06:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aefbd01-a528-5883-8885-0ae537b6a74f with identifier: NY34007
2026-01-29 06:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aefbd01-a528-5883-8885-0ae537b6a74f with scrape type 2
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aefbd01-a528-5883-8885-0ae537b6a74f with scrape type 2
2026-01-29 06:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8aefbd01-a528-5883-8885-0ae537b6a74f, identifier: NY34007
2026-01-29 06:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b554f9d2-5f38-5840-abf8-ae7e5c16c024 with identifier: CN46229
2026-01-29 06:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b554f9d2-5f38-5840-abf8-ae7e5c16c024 with identifier: CN46229
2026-01-29 06:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b554f9d2-5f38-5840-abf8-ae7e5c16c024 with identifier: CN46229 to the API
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN46229>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:21:53Z',
'fuel_type': 'petrol',
'id': 'b554f9d2-5f38-5840-abf8-ae7e5c16c024',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN46229',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'Dacia',
'model': 'Duster',
'odometer': 110050,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_4b8e7790d1a0f9160d69c9eb662d17c2.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_4586f0d8440f2248f44f2a94d5d4a20c.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_a63a98d1cfce7be08fdfc2b0faca06c4.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_5fd1c386f866d29659c93586db77ebeb.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_e7a6cb4cc5ba447c11d98b01eb491d14.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_08162ebefd9afc72e024190cf62f9e36.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_829a7d6cd33703815d97e68cea654495.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_6a8aab8d35ce2c22c060a461fe8c722f.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_0ca20d6192d494efbce13d97f5c85999.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_9f39030d3ddd973634719dc06e8f6cfe.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_0195d82a1c5c411f9d268a7c1f8539a3.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_6ebba57d4d62ce5bc44c52b1187218d4.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_f8ff9fee1cb42e8d8dd11d46a05e0868.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_5273d79d93a68d45dfee58ddb232cd88.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_93ab9bb900b9fc7fc675a935508d1e54.jpg',
'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_610153484d59a8442af40e1bbaf5988c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_4b8e7790d1a0f9160d69c9eb662d17c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_4586f0d8440f2248f44f2a94d5d4a20c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_a63a98d1cfce7be08fdfc2b0faca06c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_5fd1c386f866d29659c93586db77ebeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_e7a6cb4cc5ba447c11d98b01eb491d14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_08162ebefd9afc72e024190cf62f9e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_829a7d6cd33703815d97e68cea654495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_6a8aab8d35ce2c22c060a461fe8c722f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_0ca20d6192d494efbce13d97f5c85999.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_9f39030d3ddd973634719dc06e8f6cfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_0195d82a1c5c411f9d268a7c1f8539a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_6ebba57d4d62ce5bc44c52b1187218d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_f8ff9fee1cb42e8d8dd11d46a05e0868.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_5273d79d93a68d45dfee58ddb232cd88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_93ab9bb900b9fc7fc675a935508d1e54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b554f9d2-5f38-5840-abf8-ae7e5c16c024/b554f9d2-5f38-5840-abf8-ae7e5c16c024_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/13/a5131120c87fc97e75c8aa373d237128/pa/CN46229_610153484d59a8442af40e1bbaf5988c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe SL 2019',
'transmission': 'manual',
'trim': 'SL 2019',
'year': 2019}
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN46229%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.es] INFO: Saving data for CN46229: {'created_time': 1769666461.156108, 'last_price_update_time': 1769666461.156118, 'auction_closing_time': 1769703713.0}
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN46229') HTTP/1.1" 204 0
2026-01-29 06:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf79e054-b31f-546d-b4d8-0f025bb69f98 with identifier: UF82810
2026-01-29 06:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf79e054-b31f-546d-b4d8-0f025bb69f98 with identifier: UF82810
2026-01-29 06:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 56961, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf82810', 'expiration_date': '2026-01-29t16:29:58z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'bf79e054-b31f-546d-b4d8-0f025bb69f98', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 56961}
Failed validating None in schema:
False
On instance:
{'age_in_months': 33,
'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2026-01-29t16:29:58z',
'fuel_type': 'petrol',
'id': 'bf79e054-b31f-546d-b4d8-0f025bb69f98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf82810',
'listing': 'auction',
'location': 'es, madrid',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 56961,
'odometer_in_km': 56961,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-20',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
2026-01-29 06:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: bf79e054-b31f-546d-b4d8-0f025bb69f98 spider: auto1.es
2026-01-29 06:01:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bf79e054-b31f-546d-b4d8-0f025bb69f98 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 56961, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf82810', 'expiration_date': '2026-01-29t16:29:58z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'bf79e054-b31f-546d-b4d8-0f025bb69f98', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 56961}
Failed validating None in schema:
False
On instance:
{'age_in_months': 33,
'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2026-01-29t16:29:58z',
'fuel_type': 'petrol',
'id': 'bf79e054-b31f-546d-b4d8-0f025bb69f98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf82810',
'listing': 'auction',
'location': 'es, madrid',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 56961,
'odometer_in_km': 56961,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-20',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:29:58Z',
'fuel_type': 'petrol',
'id': 'bf79e054-b31f-546d-b4d8-0f025bb69f98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF82810',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Peugeot',
'model': '3008',
'odometer': 56961,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF82810%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.es] INFO: Saving data for UF82810: {'auction_closing_time': 1769704198.0, 'created_time': 1769446845.519989, 'last_price_update_time': 1769666461.463342}
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF82810') HTTP/1.1" 204 0
2026-01-29 06:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8aefbd01-a528-5883-8885-0ae537b6a74f with identifier: NY34007
2026-01-29 06:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8aefbd01-a528-5883-8885-0ae537b6a74f with identifier: NY34007
2026-01-29 06:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8aefbd01-a528-5883-8885-0ae537b6a74f spider: auto1.es
2026-01-29 06:01:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8aefbd01-a528-5883-8885-0ae537b6a74f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:59:04Z',
'fuel_type': 'diesel',
'id': '8aefbd01-a528-5883-8885-0ae537b6a74f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY34007',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 173854,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
'transmission': 'manual',
'trim': 'Shine M',
'year': 2019}
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY34007%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.es] INFO: Saving data for NY34007: {'auction_closing_time': 1769705944.0, 'created_time': 1768543258.290467, 'last_price_update_time': 1769666461.700659}
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY34007') HTTP/1.1" 204 0
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_754ddc2fc74531319f7fdb25058e1c37.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_754ddc2fc74531319f7fdb25058e1c37.jpg not downloaded yet
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96cbbae3f72cb267afa4fa98f01d731b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7b29414946f977b6766fcb1c0a931c28.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9b88682794448fb92a7d9eb7866f198a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_6b6e52297e8023e94f377f20430c052a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96481889c9ba2bf778a7229be2d4baf1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_aeb397e1dba52040cca663cbfb091ee7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP18472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1b6410>
2026-01-29 06:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_ffa6fe372ca0232edeb2379ac7c889cf.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_ffa6fe372ca0232edeb2379ac7c889cf.jpg saved to cache
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c05fd9f-fd88-5a6c-9209-8712a0276f76 with identifier: UB75333
2026-01-29 06:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76 with scrape type 1
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_c57179acdf46ac513141dd826fce61df.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_c57179acdf46ac513141dd826fce61df.jpg not downloaded yet
2026-01-29 06:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd166f8-a4bd-5c82-a636-f3858d88f77b with identifier: BP61591
2026-01-29 06:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd166f8-a4bd-5c82-a636-f3858d88f77b with scrape type 2
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd166f8-a4bd-5c82-a636-f3858d88f77b with scrape type 2
2026-01-29 06:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2bd166f8-a4bd-5c82-a636-f3858d88f77b, identifier: BP61591
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_2dd3d86406824f11d7d6965057d736cd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_2dd3d86406824f11d7d6965057d736cd.jpg not downloaded yet
2026-01-29 06:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2bd166f8-a4bd-5c82-a636-f3858d88f77b with identifier: BP61591
2026-01-29 06:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2bd166f8-a4bd-5c82-a636-f3858d88f77b with identifier: BP61591
2026-01-29 06:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2bd166f8-a4bd-5c82-a636-f3858d88f77b with identifier: BP61591 to the API
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP61591>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:40:02Z',
'fuel_type': 'petrol',
'id': '2bd166f8-a4bd-5c82-a636-f3858d88f77b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP61591',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Seat',
'model': 'Arona',
'odometer': 32702,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2024}
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.es] INFO: Saving data for BP61591: {'auction_closing_time': 1769704802.0, 'created_time': 1767872438.07906, 'last_price_update_time': 1769666462.612849}
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP61591') HTTP/1.1" 204 0
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_88281d8e133cbc101562aea474a736a0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_88281d8e133cbc101562aea474a736a0.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_d6ef7b964b9ca6694f734b45fab094ec.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_d6ef7b964b9ca6694f734b45fab094ec.jpg not downloaded yet
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c12b690>
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_96cbbae3f72cb267afa4fa98f01d731b.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96cbbae3f72cb267afa4fa98f01d731b.jpg saved to cache
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2d4950>
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_7b29414946f977b6766fcb1c0a931c28.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7b29414946f977b6766fcb1c0a931c28.jpg saved to cache
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2604d0>
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_9b88682794448fb92a7d9eb7866f198a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9b88682794448fb92a7d9eb7866f198a.jpg saved to cache
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d13910>
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_6b6e52297e8023e94f377f20430c052a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_6b6e52297e8023e94f377f20430c052a.jpg saved to cache
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d12d10>
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_96481889c9ba2bf778a7229be2d4baf1.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96481889c9ba2bf778a7229be2d4baf1.jpg saved to cache
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2d5c90>
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_aeb397e1dba52040cca663cbfb091ee7.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_aeb397e1dba52040cca663cbfb091ee7.jpg saved to cache
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9fe4646a3b47e5190e8f96c74f5282dc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_ecd3c6b68a4a1653d8d9e234f033af62.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_ecd3c6b68a4a1653d8d9e234f033af62.jpg not downloaded yet
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_97874994efbf190000e644841784c884.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_97874994efbf190000e644841784c884.jpg not downloaded yet
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_150d0bdf0a46973fbf38b9553e539025.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_29348458dfb3d426874e3b3c795e7172.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_754ddc2fc74531319f7fdb25058e1c37.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3a9f2722a759c78617127b563167738f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_d8f16cdc52da651d564122c1b6f21612.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_5f5a6789918503a1e00b120e03959ca6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_5f5a6789918503a1e00b120e03959ca6.jpg not downloaded yet
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM34315> (referer: https://www.auto1.com/v1/car-details-view/RM34315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT15505> (referer: https://www.auto1.com/v1/car-details-view/RT15505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY33498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB91679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG99809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_647a28760ab1ca3382bab7063afc0ec1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_647a28760ab1ca3382bab7063afc0ec1.jpg not downloaded yet
2026-01-29 06:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_2807cac12f904ace25a259a41e3ebb78.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2807cac12f904ace25a259a41e3ebb78.jpg not downloaded yet
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_66c203ab2d72873bfc8acdb05e967bd0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_66c203ab2d72873bfc8acdb05e967bd0.jpg not downloaded yet
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_adf8e8b009b0709902a0d3db8e55770f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_adf8e8b009b0709902a0d3db8e55770f.jpg not downloaded yet
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c214b50>
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_9fe4646a3b47e5190e8f96c74f5282dc.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9fe4646a3b47e5190e8f96c74f5282dc.jpg saved to cache
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_ad51bbedfb518133132a3c9951c17459.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_ad51bbedfb518133132a3c9951c17459.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_9090a89ed9038d1ddd085abb16295149.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_9090a89ed9038d1ddd085abb16295149.jpg not downloaded yet
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_2dd3d86406824f11d7d6965057d736cd.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_ecd3c6b68a4a1653d8d9e234f033af62.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_c57179acdf46ac513141dd826fce61df.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_d6ef7b964b9ca6694f734b45fab094ec.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_97874994efbf190000e644841784c884.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_88281d8e133cbc101562aea474a736a0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_fc2efb8e7c9ff6b5ea863398b73fadcb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_3a03ae5fa7ed6f37f2b8bcee2daf75e6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_3a03ae5fa7ed6f37f2b8bcee2daf75e6.jpg not downloaded yet
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_cb73629535e301fdd261e6321e109085.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_7593b11696a5ef7f375c13ac6e1dedaf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_7593b11696a5ef7f375c13ac6e1dedaf.jpg not downloaded yet
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c98b50>
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_150d0bdf0a46973fbf38b9553e539025.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_150d0bdf0a46973fbf38b9553e539025.jpg saved to cache
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655ca7710>
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_29348458dfb3d426874e3b3c795e7172.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_29348458dfb3d426874e3b3c795e7172.jpg saved to cache
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c94f50>
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_754ddc2fc74531319f7fdb25058e1c37.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_754ddc2fc74531319f7fdb25058e1c37.jpg saved to cache
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c9f710>
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_3a9f2722a759c78617127b563167738f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3a9f2722a759c78617127b563167738f.jpg saved to cache
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c9b150>
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_d8f16cdc52da651d564122c1b6f21612.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_d8f16cdc52da651d564122c1b6f21612.jpg saved to cache
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:06 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315
2026-01-29 06:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b325d5-54fd-56e6-8d5a-90708621380c with scrape type 2
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b325d5-54fd-56e6-8d5a-90708621380c with scrape type 2
2026-01-29 06:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6b325d5-54fd-56e6-8d5a-90708621380c, identifier: RM34315
2026-01-29 06:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f119b3-e3b2-5b6d-9892-9f098d647f52 with identifier: RT15505
2026-01-29 06:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f119b3-e3b2-5b6d-9892-9f098d647f52 with scrape type 2
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f119b3-e3b2-5b6d-9892-9f098d647f52 with scrape type 2
2026-01-29 06:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 06f119b3-e3b2-5b6d-9892-9f098d647f52, identifier: RT15505
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_6a66ac97d5680b8c9fdae1c1e7e7f827.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6a66ac97d5680b8c9fdae1c1e7e7f827.jpg not downloaded yet
2026-01-29 06:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315
2026-01-29 06:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315
2026-01-29 06:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315 to the API
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM34315>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:57:51Z',
'fuel_type': 'diesel',
'id': 'b6b325d5-54fd-56e6-8d5a-90708621380c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM34315',
'listing': 'auction',
'location': 'ES, Alcalá de Henares, Madrid',
'make': 'Opel',
'model': 'Corsa',
'odometer': 95324,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.5 CDTI GS Line',
'transmission': 'manual',
'trim': 'GS Line',
'year': 2020}
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM34315%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.es] INFO: Saving data for RM34315: {'auction_closing_time': 1769705871.0, 'created_time': 1768298910.935714, 'last_price_update_time': 1769666467.480434}
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RM34315') HTTP/1.1" 204 0
2026-01-29 06:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 06f119b3-e3b2-5b6d-9892-9f098d647f52 with identifier: RT15505
2026-01-29 06:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 06f119b3-e3b2-5b6d-9892-9f098d647f52 with identifier: RT15505
2026-01-29 06:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 06f119b3-e3b2-5b6d-9892-9f098d647f52 with identifier: RT15505 to the API
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT15505>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 252,
'expiration_date': '2026-01-29T16:39:37Z',
'fuel_type': 'petrol',
'id': '06f119b3-e3b2-5b6d-9892-9f098d647f52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT15505',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'BMW',
'model': '5er',
'odometer': 101202,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT15505%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.es] INFO: Saving data for RT15505: {'auction_closing_time': 1769704777.0, 'created_time': 1767364912.929192, 'last_price_update_time': 1769666467.883106}
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT15505') HTTP/1.1" 204 0
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_8f960b891e2a8043eaa2601c93f0e354.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_2d700c11dc2ce1cfe39dc1a417242951.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2d700c11dc2ce1cfe39dc1a417242951.jpg not downloaded yet
2026-01-29 06:01:07 [auto1.es] INFO: Found listing with ID: GZ65058
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65058%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.es] INFO: Scrape type for GZ65058: 0
2026-01-29 06:01:07 [auto1.es] INFO: Found listing with ID: TX26882
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX26882%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.es] INFO: Scrape type for TX26882: 0
2026-01-29 06:01:07 [auto1.es] INFO: Found listing with ID: LW57020
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW57020%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.es] INFO: Scrape type for LW57020: 0
2026-01-29 06:01:07 [auto1.es] INFO: Found listing with ID: NJ49503
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ49503%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.es] INFO: Scrape type for NJ49503: 0
2026-01-29 06:01:08 [auto1.es] INFO: Found listing with ID: XW22708
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW22708%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.es] INFO: Scrape type for XW22708: 2
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d45890>
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_2dd3d86406824f11d7d6965057d736cd.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_2dd3d86406824f11d7d6965057d736cd.jpg saved to cache
2026-01-29 06:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c210f90>
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_ecd3c6b68a4a1653d8d9e234f033af62.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_ecd3c6b68a4a1653d8d9e234f033af62.jpg saved to cache
2026-01-29 06:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c211910>
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_c57179acdf46ac513141dd826fce61df.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_c57179acdf46ac513141dd826fce61df.jpg saved to cache
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655dfd990>
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_d6ef7b964b9ca6694f734b45fab094ec.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_d6ef7b964b9ca6694f734b45fab094ec.jpg saved to cache
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655ce7b90>
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_97874994efbf190000e644841784c884.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_97874994efbf190000e644841784c884.jpg saved to cache
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065d9a61d0>
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_88281d8e133cbc101562aea474a736a0.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_88281d8e133cbc101562aea474a736a0.jpg saved to cache
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f06577334d0>
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_fc2efb8e7c9ff6b5ea863398b73fadcb.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_fc2efb8e7c9ff6b5ea863398b73fadcb.jpg saved to cache
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_e8d95451e16f31428e1ba1fb95aae26f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_af05208a998f1aaa35c7e2dfab1a0141.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_de5ca1803b6133b81fda00d1c494f944.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_de5ca1803b6133b81fda00d1c494f944.jpg not downloaded yet
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX70462> (referer: https://www.auto1.com/v1/car-details-view/SX70462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_647a28760ab1ca3382bab7063afc0ec1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_66c203ab2d72873bfc8acdb05e967bd0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_ad51bbedfb518133132a3c9951c17459.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_adf8e8b009b0709902a0d3db8e55770f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2807cac12f904ace25a259a41e3ebb78.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_361fc231ead5b67d791320f40c5aff2e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_361fc231ead5b67d791320f40c5aff2e.jpg not downloaded yet
2026-01-29 06:01:10 [auto1.es] INFO: Found listing with ID: NF50708
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF50708%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [auto1.es] INFO: Scrape type for NF50708: 0
2026-01-29 06:01:10 [auto1.es] INFO: Found listing with ID: HE35950
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE35950%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [auto1.es] INFO: Scrape type for HE35950: 2
2026-01-29 06:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c279310>
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F53%252F9e536e006059f97a0b7a9098a45f49b8%252Fpa%252FZK09495_cb73629535e301fdd261e6321e109085.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_cb73629535e301fdd261e6321e109085.jpg saved to cache
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eaabcb68-2605-5c06-9b67-0af724510263
2026-01-29 06:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eaabcb68-2605-5c06-9b67-0af724510263, skipping ID generation
2026-01-29 06:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaabcb68-2605-5c06-9b67-0af724510263 with scrape type 1
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eaabcb68-2605-5c06-9b67-0af724510263 from tracking dictionaries
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eaabcb68-2605-5c06-9b67-0af724510263 sending to next pipeline
2026-01-29 06:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eaabcb68-2605-5c06-9b67-0af724510263, identifier: ZK09495
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_6bdb598eb5aa3f88aeb135443fe7cd09.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6bdb598eb5aa3f88aeb135443fe7cd09.jpg not downloaded yet
2026-01-29 06:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eaabcb68-2605-5c06-9b67-0af724510263 with identifier: ZK09495
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-29 06:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eaabcb68-2605-5c06-9b67-0af724510263 with identifier: ZK09495
2026-01-29 06:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eaabcb68-2605-5c06-9b67-0af724510263 with identifier: ZK09495 to the API
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_cb73629535e301fdd261e6321e109085.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:23:06Z',
'fuel_type': 'petrol',
'id': 'eaabcb68-2605-5c06-9b67-0af724510263',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK09495',
'listing': 'auction',
'location': 'ES, Manacor',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 66906,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_cb73629535e301fdd261e6321e109085.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_241289b41181159eea2c8ca6bc56573d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9fe4646a3b47e5190e8f96c74f5282dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_9b88682794448fb92a7d9eb7866f198a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b97ee0ebe486a78f4cb9a8552fce1db4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_785d44c48dfdc954a99ece5364a25ac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_3ad9cdc60bb4a006844927d31221a4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_6fc3228eca411e5137677af9143e61d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_544b452a801129180c2698d06c5497ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_2f8a3e3ce435799afb479d0fe4870a5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_f74563499f2a4730dd30ab82a1472f38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_97aa3d9eecd4d580bc125030bc1e2020.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_77454f33aa87e1ba2300ce19500a6ae6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_171487239b9c489a3c437a6c6edbaadf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_b8e17376298abca9cb01344ab4fe4c46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaabcb68-2605-5c06-9b67-0af724510263/eaabcb68-2605-5c06-9b67-0af724510263_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/53/9e536e006059f97a0b7a9098a45f49b8/pa/ZK09495_48faaf9c4106d368c5bc902839640959.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.5 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2018}
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK09495%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [auto1.es] INFO: Saving data for ZK09495: {'created_time': 1769666471.469373, 'last_price_update_time': 1769666471.469384, 'auction_closing_time': 1769703786.0}
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK09495') HTTP/1.1" 204 0
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2b7410>
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_8f960b891e2a8043eaa2601c93f0e354.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_8f960b891e2a8043eaa2601c93f0e354.jpg saved to cache
2026-01-29 06:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_08b3422880e25f2f86721acd9fad80a4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_08b3422880e25f2f86721acd9fad80a4.jpg not downloaded yet
2026-01-29 06:01:11 [auto1.es] INFO: Found listing with ID: CY53748
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY53748%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [auto1.es] INFO: Scrape type for CY53748: 0
2026-01-29 06:01:11 [auto1.es] INFO: Found listing with ID: SU61206
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU61206%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [auto1.es] INFO: Scrape type for SU61206: 0
2026-01-29 06:01:11 [auto1.es] INFO: Found listing with ID: ED56686
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED56686%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [auto1.es] INFO: Scrape type for ED56686: 0
2026-01-29 06:01:11 [auto1.es] INFO: Found listing with ID: RE96248
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE96248%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [auto1.es] INFO: Scrape type for RE96248: 0
2026-01-29 06:01:11 [auto1.es] INFO: Found listing with ID: XF61793
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF61793%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [auto1.es] INFO: Scrape type for XF61793: 2
2026-01-29 06:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_5f5a6789918503a1e00b120e03959ca6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_78f109ac034c2936f92a88236cf4b490.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_9090a89ed9038d1ddd085abb16295149.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_9770fedd68a95196a2c8b0c0bfc9ce62.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9770fedd68a95196a2c8b0c0bfc9ce62.jpg not downloaded yet
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c124550>
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_e8d95451e16f31428e1ba1fb95aae26f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_e8d95451e16f31428e1ba1fb95aae26f.jpg saved to cache
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655b02750>
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_af05208a998f1aaa35c7e2dfab1a0141.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_af05208a998f1aaa35c7e2dfab1a0141.jpg saved to cache
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce44927-8127-5b48-8b26-9f12d792f8a8 with identifier: SX70462
2026-01-29 06:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce44927-8127-5b48-8b26-9f12d792f8a8 with scrape type 2
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce44927-8127-5b48-8b26-9f12d792f8a8 with scrape type 2
2026-01-29 06:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ce44927-8127-5b48-8b26-9f12d792f8a8, identifier: SX70462
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655b1eb90>
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_647a28760ab1ca3382bab7063afc0ec1.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_647a28760ab1ca3382bab7063afc0ec1.jpg saved to cache
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c350d0>
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_66c203ab2d72873bfc8acdb05e967bd0.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_66c203ab2d72873bfc8acdb05e967bd0.jpg saved to cache
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c128d50>
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_ad51bbedfb518133132a3c9951c17459.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_ad51bbedfb518133132a3c9951c17459.jpg saved to cache
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d3de90>
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_adf8e8b009b0709902a0d3db8e55770f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_adf8e8b009b0709902a0d3db8e55770f.jpg saved to cache
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c132cd0>
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_2807cac12f904ace25a259a41e3ebb78.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2807cac12f904ace25a259a41e3ebb78.jpg saved to cache
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6a66ac97d5680b8c9fdae1c1e7e7f827.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_77db31bdfbd5adeaec63076d6862b242.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_77db31bdfbd5adeaec63076d6862b242.jpg not downloaded yet
2026-01-29 06:01:14 [auto1.es] INFO: Found listing with ID: TL27510
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL27510%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [auto1.es] INFO: Scrape type for TL27510: 0
2026-01-29 06:01:14 [auto1.es] INFO: Found listing with ID: VT82415
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT82415%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [auto1.es] INFO: Scrape type for VT82415: 2
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC52859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP18472> (referer: https://www.auto1.com/v1/car-details-view/DP18472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF93230> (referer: https://www.auto1.com/v1/car-details-view/SF93230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD60127> (referer: https://www.auto1.com/v1/car-details-view/BD60127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ce44927-8127-5b48-8b26-9f12d792f8a8 with identifier: SX70462
2026-01-29 06:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ce44927-8127-5b48-8b26-9f12d792f8a8 with identifier: SX70462
2026-01-29 06:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ce44927-8127-5b48-8b26-9f12d792f8a8 with identifier: SX70462 to the API
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX70462>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-01-29T16:55:56Z',
'fuel_type': 'petrol',
'id': '1ce44927-8127-5b48-8b26-9f12d792f8a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX70462',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 102948,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2019}
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX70462%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [auto1.es] INFO: Saving data for SX70462: {'auction_closing_time': 1769705756.0, 'created_time': 1767780139.932809, 'last_price_update_time': 1769666476.139597}
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SX70462') HTTP/1.1" 204 0
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2d700c11dc2ce1cfe39dc1a417242951.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_3a03ae5fa7ed6f37f2b8bcee2daf75e6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_5861a8db466fb3fcdce337f723673aac.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_5861a8db466fb3fcdce337f723673aac.jpg not downloaded yet
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_7593b11696a5ef7f375c13ac6e1dedaf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_3d85de76f8fb6916e4ac305959f5dafc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_3d85de76f8fb6916e4ac305959f5dafc.jpg not downloaded yet
2026-01-29 06:01:16 [auto1.es] INFO: Found listing with ID: AE10228
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE10228%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [auto1.es] INFO: Scrape type for AE10228: 2
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG99809> (referer: https://www.auto1.com/v1/car-details-view/FG99809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d711d0>
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_5f5a6789918503a1e00b120e03959ca6.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_5f5a6789918503a1e00b120e03959ca6.jpg saved to cache
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1c5050>
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_78f109ac034c2936f92a88236cf4b490.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_78f109ac034c2936f92a88236cf4b490.jpg saved to cache
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c381190>
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_9090a89ed9038d1ddd085abb16295149.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_9090a89ed9038d1ddd085abb16295149.jpg saved to cache
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_9096b1dfa627e73bb1c955d50a65dcb2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9096b1dfa627e73bb1c955d50a65dcb2.jpg not downloaded yet
2026-01-29 06:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_361fc231ead5b67d791320f40c5aff2e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_fba3aa5c42beed8a5baf483afa933c76.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_fba3aa5c42beed8a5baf483afa933c76.jpg not downloaded yet
2026-01-29 06:01:17 [auto1.es] INFO: Found listing with ID: CX32181
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX32181%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [auto1.es] INFO: Scrape type for CX32181: 0
2026-01-29 06:01:17 [auto1.es] INFO: Found listing with ID: BE03289
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE03289%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [auto1.es] INFO: Scrape type for BE03289: 0
2026-01-29 06:01:17 [auto1.es] INFO: Found listing with ID: KL70235
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL70235%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [auto1.es] INFO: Scrape type for KL70235: 0
2026-01-29 06:01:17 [auto1.es] INFO: Found listing with ID: CC08636
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC08636%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [auto1.es] INFO: Scrape type for CC08636: 2
2026-01-29 06:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655dd70d0>
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_6a66ac97d5680b8c9fdae1c1e7e7f827.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6a66ac97d5680b8c9fdae1c1e7e7f827.jpg saved to cache
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1577c133-6d2b-53c8-8b79-48c5b3061e34 with identifier: DP18472
2026-01-29 06:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1577c133-6d2b-53c8-8b79-48c5b3061e34 with scrape type 2
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1577c133-6d2b-53c8-8b79-48c5b3061e34 with scrape type 2
2026-01-29 06:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1577c133-6d2b-53c8-8b79-48c5b3061e34, identifier: DP18472
2026-01-29 06:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f34bd43-fecb-5596-a438-833315681b0b with identifier: SF93230
2026-01-29 06:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f34bd43-fecb-5596-a438-833315681b0b with scrape type 2
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f34bd43-fecb-5596-a438-833315681b0b with scrape type 2
2026-01-29 06:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f34bd43-fecb-5596-a438-833315681b0b, identifier: SF93230
2026-01-29 06:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aca7b730-73b3-5cb5-a941-c58362becbed with identifier: BD60127
2026-01-29 06:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aca7b730-73b3-5cb5-a941-c58362becbed with scrape type 2
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aca7b730-73b3-5cb5-a941-c58362becbed with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aca7b730-73b3-5cb5-a941-c58362becbed, identifier: BD60127
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9770fedd68a95196a2c8b0c0bfc9ce62.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5a4cdd9c8d39d22adc65b0c15d622e10.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6bdb598eb5aa3f88aeb135443fe7cd09.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_45e00f6d114224475683d3340f8ffdf4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_45e00f6d114224475683d3340f8ffdf4.jpg not downloaded yet
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB91679> (referer: https://www.auto1.com/v1/car-details-view/YB91679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY33498> (referer: https://www.auto1.com/v1/car-details-view/EY33498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW22708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1577c133-6d2b-53c8-8b79-48c5b3061e34 with identifier: DP18472
2026-01-29 06:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1577c133-6d2b-53c8-8b79-48c5b3061e34 with identifier: DP18472
2026-01-29 06:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1577c133-6d2b-53c8-8b79-48c5b3061e34 with identifier: DP18472 to the API
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP18472>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:34:41Z',
'fuel_type': 'petrol',
'id': '1577c133-6d2b-53c8-8b79-48c5b3061e34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP18472',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Seat',
'model': 'Ateca',
'odometer': 62001,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2022}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP18472%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [auto1.es] INFO: Saving data for DP18472: {'auction_closing_time': 1769704481.0, 'created_time': 1769447200.903519, 'last_price_update_time': 1769666478.403911}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DP18472') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f34bd43-fecb-5596-a438-833315681b0b with identifier: SF93230
2026-01-29 06:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f34bd43-fecb-5596-a438-833315681b0b with identifier: SF93230
2026-01-29 06:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f34bd43-fecb-5596-a438-833315681b0b with identifier: SF93230 to the API
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF93230>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 106,
'expiration_date': '2026-01-29T16:17:57Z',
'fuel_type': 'petrol',
'id': '2f34bd43-fecb-5596-a438-833315681b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF93230',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'MG',
'model': 'ZS',
'odometer': 31224,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'MG ZS 1.5 VTi Luxury',
'transmission': 'manual',
'trim': 'Luxury',
'year': 2022}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF93230%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [auto1.es] INFO: Saving data for SF93230: {'auction_closing_time': 1769703477.0, 'created_time': 1769003162.05093, 'last_price_update_time': 1769666478.718427}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SF93230') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aca7b730-73b3-5cb5-a941-c58362becbed with identifier: BD60127
2026-01-29 06:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aca7b730-73b3-5cb5-a941-c58362becbed with identifier: BD60127
2026-01-29 06:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aca7b730-73b3-5cb5-a941-c58362becbed with identifier: BD60127 to the API
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD60127>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:15:05Z',
'fuel_type': 'petrol',
'id': 'aca7b730-73b3-5cb5-a941-c58362becbed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD60127',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 106146,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Advance BlueMotion',
'transmission': 'manual',
'trim': 'Advance BlueMotion',
'year': 2020}
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD60127%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [auto1.es] INFO: Saving data for BD60127: {'auction_closing_time': 1769703305.0, 'created_time': 1767872775.612133, 'last_price_update_time': 1769666479.08098}
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BD60127') HTTP/1.1" 204 0
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_48e2618745fd618a74f1a16a4ada7990.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_70c52767ec4b8e35a105ded3ceaf6c46.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_de5ca1803b6133b81fda00d1c494f944.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_08b3422880e25f2f86721acd9fad80a4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_bd270fb89e87bee1ff25383bec637852.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_bd270fb89e87bee1ff25383bec637852.jpg not downloaded yet
2026-01-29 06:01:19 [auto1.es] INFO: Found listing with ID: JW38113
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW38113%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [auto1.es] INFO: Scrape type for JW38113: 0
2026-01-29 06:01:19 [auto1.es] INFO: Found listing with ID: ZK67918
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK67918%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [auto1.es] INFO: Scrape type for ZK67918: 0
2026-01-29 06:01:19 [auto1.es] INFO: Found listing with ID: CV57144
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV57144%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [auto1.es] INFO: Scrape type for CV57144: 2
2026-01-29 06:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c04f10>
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_2d700c11dc2ce1cfe39dc1a417242951.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2d700c11dc2ce1cfe39dc1a417242951.jpg saved to cache
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1330d0>
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_3a03ae5fa7ed6f37f2b8bcee2daf75e6.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_3a03ae5fa7ed6f37f2b8bcee2daf75e6.jpg saved to cache
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c124b10>
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_7593b11696a5ef7f375c13ac6e1dedaf.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_7593b11696a5ef7f375c13ac6e1dedaf.jpg saved to cache
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809
2026-01-29 06:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00a8036b-01c5-54f4-bd43-671fc38ed342 with scrape type 2
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00a8036b-01c5-54f4-bd43-671fc38ed342 with scrape type 2
2026-01-29 06:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00a8036b-01c5-54f4-bd43-671fc38ed342, identifier: FG99809
2026-01-29 06:01:20 [scrapy.extensions.logstats] INFO: Crawled 91 pages (at 91 pages/min), scraped 19 items (at 19 items/min)
2026-01-29 06:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809
2026-01-29 06:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809
2026-01-29 06:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809 to the API
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG99809>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:32:47Z',
'fuel_type': 'petrol',
'id': '00a8036b-01c5-54f4-bd43-671fc38ed342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG99809',
'listing': 'auction',
'location': 'ES, MADRID',
'make': 'Kia',
'model': "cee'd",
'odometer': 129175,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-28',
'seats_number': 5,
'seller_name': None,
'title': "Kia cee'd 1.0 TGDI Tech",
'transmission': 'manual',
'trim': 'Tech',
'year': 2021}
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-01-29 06:01:20 [auto1.es] INFO: Saving data for FG99809: {'auction_closing_time': 1769704367.0, 'created_time': 1769533383.423414, 'last_price_update_time': 1769666480.623985}
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG99809') HTTP/1.1" 204 0
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655b84a10>
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_361fc231ead5b67d791320f40c5aff2e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_361fc231ead5b67d791320f40c5aff2e.jpg saved to cache
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_47241467877175a850783359bd6c7b2f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_47241467877175a850783359bd6c7b2f.jpg not downloaded yet
2026-01-29 06:01:21 [auto1.es] INFO: Found listing with ID: UK95228
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK95228%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.es] INFO: Scrape type for UK95228: 0
2026-01-29 06:01:21 [auto1.es] INFO: Found listing with ID: US12212
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US12212%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.es] INFO: Scrape type for US12212: 0
2026-01-29 06:01:21 [auto1.es] INFO: Found listing with ID: DU20801
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU20801%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.es] INFO: Scrape type for DU20801: 0
2026-01-29 06:01:21 [auto1.es] INFO: Found listing with ID: YF88896
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF88896%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.es] INFO: Scrape type for YF88896: 0
2026-01-29 06:01:21 [auto1.es] INFO: Found listing with ID: YL72553
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL72553%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.es] INFO: Scrape type for YL72553: 0
2026-01-29 06:01:21 [auto1.es] INFO: Found listing with ID: GA59266
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA59266%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.es] INFO: Scrape type for GA59266: 2
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d66990>
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_9770fedd68a95196a2c8b0c0bfc9ce62.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9770fedd68a95196a2c8b0c0bfc9ce62.jpg saved to cache
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c2a9810>
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_5a4cdd9c8d39d22adc65b0c15d622e10.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5a4cdd9c8d39d22adc65b0c15d622e10.jpg saved to cache
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c9e050>
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_6bdb598eb5aa3f88aeb135443fe7cd09.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6bdb598eb5aa3f88aeb135443fe7cd09.jpg saved to cache
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a51d7a-8048-5783-afef-e915d65c1c3a with identifier: YB91679
2026-01-29 06:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a51d7a-8048-5783-afef-e915d65c1c3a with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a51d7a-8048-5783-afef-e915d65c1c3a with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08a51d7a-8048-5783-afef-e915d65c1c3a, identifier: YB91679
2026-01-29 06:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62 with identifier: EY33498
2026-01-29 06:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62 with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62 with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62, identifier: EY33498
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9096b1dfa627e73bb1c955d50a65dcb2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_3d85de76f8fb6916e4ac305959f5dafc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08a51d7a-8048-5783-afef-e915d65c1c3a with identifier: YB91679
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-29 06:01:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08a51d7a-8048-5783-afef-e915d65c1c3a with identifier: YB91679
2026-01-29 06:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08a51d7a-8048-5783-afef-e915d65c1c3a with identifier: YB91679 to the API
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB91679>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2026-01-29T16:56:50Z',
'fuel_type': 'hybrid',
'id': '08a51d7a-8048-5783-afef-e915d65c1c3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB91679',
'listing': 'auction',
'location': 'ES, Granyanella',
'make': 'Renault',
'model': 'Arkana',
'odometer': 83188,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.6 Hybrid E-Tech Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2021}
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB91679%27 HTTP/1.1" 200 None
2026-01-29 06:01:22 [auto1.es] INFO: Saving data for YB91679: {'auction_closing_time': 1769705810.0, 'created_time': 1769533471.391975, 'last_price_update_time': 1769666482.729682}
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YB91679') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62 with identifier: EY33498
2026-01-29 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62 with identifier: EY33498
2026-01-29 06:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62 with identifier: EY33498 to the API
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY33498>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:14:22Z',
'fuel_type': 'diesel',
'id': '151b49c1-72f6-5c1e-8bc9-fa7ef70b6d62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY33498',
'listing': 'auction',
'location': 'ES, Granyanella',
'make': 'Fiat',
'model': '500X',
'odometer': 60404,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2019}
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY33498%27 HTTP/1.1" 200 None
2026-01-29 06:01:23 [auto1.es] INFO: Saving data for EY33498: {'auction_closing_time': 1769703262.0, 'created_time': 1769533458.388365, 'last_price_update_time': 1769666483.177671}
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY33498') HTTP/1.1" 204 0
2026-01-29 06:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d6ff90>
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_48e2618745fd618a74f1a16a4ada7990.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_48e2618745fd618a74f1a16a4ada7990.jpg saved to cache
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655bab610>
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_70c52767ec4b8e35a105ded3ceaf6c46.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_70c52767ec4b8e35a105ded3ceaf6c46.jpg saved to cache
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f06577da210>
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_de5ca1803b6133b81fda00d1c494f944.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_de5ca1803b6133b81fda00d1c494f944.jpg saved to cache
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655ec92d0>
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_08b3422880e25f2f86721acd9fad80a4.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_08b3422880e25f2f86721acd9fad80a4.jpg saved to cache
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_77db31bdfbd5adeaec63076d6862b242.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_5861a8db466fb3fcdce337f723673aac.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: FG66132
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG66132%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for FG66132: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: GY56775
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY56775%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for GY56775: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: TH66147
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH66147%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for TH66147: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: RA35771
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA35771%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for RA35771: 2
2026-01-29 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_fba3aa5c42beed8a5baf483afa933c76.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_98d3d1d6f075901ea00f94f6bae29f86.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_23c79689df8a3c4a857d12658a0b727f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_7b1f7c526a52751f55f7295235cb438e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: LY93343
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY93343%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for LY93343: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: KM63041
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM63041%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for KM63041: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: VL30492
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL30492%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for VL30492: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: KG26344
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG26344%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for KG26344: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: BF08538
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF08538%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for BF08538: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: ZF96743
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF96743%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for ZF96743: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: WS86434
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS86434%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for WS86434: 0
2026-01-29 06:01:24 [auto1.es] INFO: Found listing with ID: ED37556
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED37556%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.es] INFO: Scrape type for ED37556: 0
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e49010>
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_9096b1dfa627e73bb1c955d50a65dcb2.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9096b1dfa627e73bb1c955d50a65dcb2.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655cd8b10>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_3d85de76f8fb6916e4ac305959f5dafc.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_3d85de76f8fb6916e4ac305959f5dafc.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_bd270fb89e87bee1ff25383bec637852.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC08636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE10228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c11c850>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_77db31bdfbd5adeaec63076d6862b242.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_77db31bdfbd5adeaec63076d6862b242.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065db2a550>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_5861a8db466fb3fcdce337f723673aac.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_5861a8db466fb3fcdce337f723673aac.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c3126d0>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_fba3aa5c42beed8a5baf483afa933c76.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_fba3aa5c42beed8a5baf483afa933c76.jpg saved to cache
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655cb1210>
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_98d3d1d6f075901ea00f94f6bae29f86.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_98d3d1d6f075901ea00f94f6bae29f86.jpg saved to cache
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655df9090>
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_23c79689df8a3c4a857d12658a0b727f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_23c79689df8a3c4a857d12658a0b727f.jpg saved to cache
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655b80d50>
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_7b1f7c526a52751f55f7295235cb438e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_7b1f7c526a52751f55f7295235cb438e.jpg saved to cache
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_45e00f6d114224475683d3340f8ffdf4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_18ac83ad756f5a1fb531ca61f01c4c20.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_744e9f6eacb8c7caf65592b86456c218.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_47241467877175a850783359bd6c7b2f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC52859> (referer: https://www.auto1.com/v1/car-details-view/JC52859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT82415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE35950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF61793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV57144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0657747d10>
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F89360f65d5208082c5abc070a623dd54%252Fpa%252FEP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg saved to cache
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595
2026-01-29 06:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd38d896-4f9e-5e4d-80d9-7e3b133d9595, skipping ID generation
2026-01-29 06:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595 with scrape type 1
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fd38d896-4f9e-5e4d-80d9-7e3b133d9595 from tracking dictionaries
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd38d896-4f9e-5e4d-80d9-7e3b133d9595 sending to next pipeline
2026-01-29 06:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd38d896-4f9e-5e4d-80d9-7e3b133d9595, identifier: EP09349
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065d911990>
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_bd270fb89e87bee1ff25383bec637852.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_bd270fb89e87bee1ff25383bec637852.jpg saved to cache
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd38d896-4f9e-5e4d-80d9-7e3b133d9595 with identifier: EP09349
2026-01-29 06:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd38d896-4f9e-5e4d-80d9-7e3b133d9595 with identifier: EP09349
2026-01-29 06:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd38d896-4f9e-5e4d-80d9-7e3b133d9595 with identifier: EP09349 to the API
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:17:54Z',
'fuel_type': 'diesel',
'id': 'fd38d896-4f9e-5e4d-80d9-7e3b133d9595',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP09349',
'listing': 'auction',
'location': 'ES, Huelva',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 95851,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6eead744cc9c6edf87fe0cb3f1cff1a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_b387cf421b00484850ff5d476e90501e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_7b1f7c526a52751f55f7295235cb438e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_70c52767ec4b8e35a105ded3ceaf6c46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_8f960b891e2a8043eaa2601c93f0e354.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_fc2efb8e7c9ff6b5ea863398b73fadcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_6e7b6bda639bb1b95187ea205e32a004.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_d8f16cdc52da651d564122c1b6f21612.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_aeb397e1dba52040cca663cbfb091ee7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1e915284cfba9060c5ddf59cced178d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_9ba65afb9b130dc1c6a37f73058faaed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_2886d05e21f285fd4f006cce715f4a92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_518b307fb9474571712e86f4d9a554ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_a242d93ef111e6aa5e07ef19d03417e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_1c27720b53c20084031c59de7676ba4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd38d896-4f9e-5e4d-80d9-7e3b133d9595/fd38d896-4f9e-5e4d-80d9-7e3b133d9595_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/36/89360f65d5208082c5abc070a623dd54/pa/EP09349_21e5f7b4a8b891e424edf8631aa4ecca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-17',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.6 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2018}
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP09349%27 HTTP/1.1" 200 None
2026-01-29 06:01:28 [auto1.es] INFO: Saving data for EP09349: {'created_time': 1769666488.292671, 'last_price_update_time': 1769666488.292682, 'auction_closing_time': 1769703474.0}
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP09349') HTTP/1.1" 204 0
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3b20b19e3be600e186c4eb6cdca6f944.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655da18d0>
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fdd%252F4add165e023fc6fdbf6d96f4724b5e99%252Fpa%252FZM34040_45e00f6d114224475683d3340f8ffdf4.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_45e00f6d114224475683d3340f8ffdf4.jpg saved to cache
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0
2026-01-29 06:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fef69f7d-5ae1-50ff-9b34-499f9f32a8b0, skipping ID generation
2026-01-29 06:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 with scrape type 1
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 from tracking dictionaries
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 sending to next pipeline
2026-01-29 06:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fef69f7d-5ae1-50ff-9b34-499f9f32a8b0, identifier: ZM34040
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1aef90>
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_18ac83ad756f5a1fb531ca61f01c4c20.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_18ac83ad756f5a1fb531ca61f01c4c20.jpg saved to cache
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:29 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c7e590>
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F8e%252F658ed2e1e44133669809ed58a3179d5c%252Fpa%252FGH34760_744e9f6eacb8c7caf65592b86456c218.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_744e9f6eacb8c7caf65592b86456c218.jpg saved to cache
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e
2026-01-29 06:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17f7edd6-8afa-56b7-9cb6-fda58367b36e, skipping ID generation
2026-01-29 06:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e with scrape type 1
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 17f7edd6-8afa-56b7-9cb6-fda58367b36e from tracking dictionaries
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17f7edd6-8afa-56b7-9cb6-fda58367b36e sending to next pipeline
2026-01-29 06:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17f7edd6-8afa-56b7-9cb6-fda58367b36e, identifier: GH34760
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e0a550>
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728f691390326b71f377784e7ea7b5f%252Fpa%252FUB75333_47241467877175a850783359bd6c7b2f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_47241467877175a850783359bd6c7b2f.jpg saved to cache
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76
2026-01-29 06:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c05fd9f-fd88-5a6c-9209-8712a0276f76, skipping ID generation
2026-01-29 06:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76 with scrape type 1
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c05fd9f-fd88-5a6c-9209-8712a0276f76 from tracking dictionaries
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c05fd9f-fd88-5a6c-9209-8712a0276f76 sending to next pipeline
2026-01-29 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c05fd9f-fd88-5a6c-9209-8712a0276f76, identifier: UB75333
2026-01-29 06:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24dc9168-6481-5ce4-8e92-5e207cf66a21 with identifier: JC52859
2026-01-29 06:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24dc9168-6481-5ce4-8e92-5e207cf66a21 with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24dc9168-6481-5ce4-8e92-5e207cf66a21 with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24dc9168-6481-5ce4-8e92-5e207cf66a21, identifier: JC52859
2026-01-29 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 with identifier: ZM34040
2026-01-29 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 with identifier: ZM34040
2026-01-29 06:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fef69f7d-5ae1-50ff-9b34-499f9f32a8b0 with identifier: ZM34040 to the API
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_45e00f6d114224475683d3340f8ffdf4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-29T16:58:08Z',
'fuel_type': 'petrol',
'id': 'fef69f7d-5ae1-50ff-9b34-499f9f32a8b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM34040',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Fiat',
'model': '500',
'odometer': 55264,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_29348458dfb3d426874e3b3c795e7172.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_754ddc2fc74531319f7fdb25058e1c37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_2dd3d86406824f11d7d6965057d736cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_d6ef7b964b9ca6694f734b45fab094ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_97874994efbf190000e644841784c884.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_647a28760ab1ca3382bab7063afc0ec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_66c203ab2d72873bfc8acdb05e967bd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_ad51bbedfb518133132a3c9951c17459.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_3a03ae5fa7ed6f37f2b8bcee2daf75e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6a66ac97d5680b8c9fdae1c1e7e7f827.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_de5ca1803b6133b81fda00d1c494f944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_6bdb598eb5aa3f88aeb135443fe7cd09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9770fedd68a95196a2c8b0c0bfc9ce62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_5861a8db466fb3fcdce337f723673aac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_9096b1dfa627e73bb1c955d50a65dcb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef69f7d-5ae1-50ff-9b34-499f9f32a8b0/fef69f7d-5ae1-50ff-9b34-499f9f32a8b0_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/dd/4add165e023fc6fdbf6d96f4724b5e99/pa/ZM34040_45e00f6d114224475683d3340f8ffdf4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-25',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2021}
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM34040%27 HTTP/1.1" 200 None
2026-01-29 06:01:30 [auto1.es] INFO: Saving data for ZM34040: {'created_time': 1769666490.535056, 'last_price_update_time': 1769666490.53507, 'auction_closing_time': 1769705888.0}
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM34040') HTTP/1.1" 204 0
2026-01-29 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17f7edd6-8afa-56b7-9cb6-fda58367b36e with identifier: GH34760
2026-01-29 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17f7edd6-8afa-56b7-9cb6-fda58367b36e with identifier: GH34760
2026-01-29 06:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 17f7edd6-8afa-56b7-9cb6-fda58367b36e with identifier: GH34760 to the API
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_744e9f6eacb8c7caf65592b86456c218.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:56:01Z',
'fuel_type': 'diesel',
'id': '17f7edd6-8afa-56b7-9cb6-fda58367b36e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH34760',
'listing': 'auction',
'location': 'ES, RubÃ',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 119106,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_744e9f6eacb8c7caf65592b86456c218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_3a603de5a76010fbbb73f5a3e94bea3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_98d3d1d6f075901ea00f94f6bae29f86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5a4cdd9c8d39d22adc65b0c15d622e10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_78f109ac034c2936f92a88236cf4b490.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_e8d95451e16f31428e1ba1fb95aae26f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_45915de440ab4f691359bec926360266.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_150d0bdf0a46973fbf38b9553e539025.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_6b6e52297e8023e94f377f20430c052a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7b29414946f977b6766fcb1c0a931c28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_9aac3bf51f67fd78d4e90fa4b8f5c41c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_290b7bc2b7f8103efb94842874ecbbed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_7cadf0bb6125465ef7dd6fa38e69854b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_15fb2b6605afcf75b6871d41de74d9a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_13da87eed39b60dd8bd7d4ae53a8650e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f7edd6-8afa-56b7-9cb6-fda58367b36e/17f7edd6-8afa-56b7-9cb6-fda58367b36e_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/8e/658ed2e1e44133669809ed58a3179d5c/pa/GH34760_5d97ddbba39b447ca779ab29962ee6e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Sport 4Motion BlueMotion',
'year': 2020}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH34760%27 HTTP/1.1" 200 None
2026-01-29 06:01:31 [auto1.es] INFO: Saving data for GH34760: {'created_time': 1769666491.015986, 'last_price_update_time': 1769666491.015996, 'auction_closing_time': 1769705761.0}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH34760') HTTP/1.1" 204 0
2026-01-29 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c05fd9f-fd88-5a6c-9209-8712a0276f76 with identifier: UB75333
2026-01-29 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c05fd9f-fd88-5a6c-9209-8712a0276f76 with identifier: UB75333
2026-01-29 06:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c05fd9f-fd88-5a6c-9209-8712a0276f76 with identifier: UB75333 to the API
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_47241467877175a850783359bd6c7b2f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:13:40Z',
'fuel_type': 'petrol',
'id': '4c05fd9f-fd88-5a6c-9209-8712a0276f76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB75333',
'listing': 'auction',
'location': 'ES, Zaragoza',
'make': 'Kia',
'model': "cee'd",
'odometer': 64000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_c57179acdf46ac513141dd826fce61df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_88281d8e133cbc101562aea474a736a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_ecd3c6b68a4a1653d8d9e234f033af62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_5f5a6789918503a1e00b120e03959ca6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2807cac12f904ace25a259a41e3ebb78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_adf8e8b009b0709902a0d3db8e55770f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_9090a89ed9038d1ddd085abb16295149.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_7593b11696a5ef7f375c13ac6e1dedaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_2d700c11dc2ce1cfe39dc1a417242951.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_361fc231ead5b67d791320f40c5aff2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_08b3422880e25f2f86721acd9fad80a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_77db31bdfbd5adeaec63076d6862b242.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_3d85de76f8fb6916e4ac305959f5dafc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_fba3aa5c42beed8a5baf483afa933c76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40505,
'Height': 597,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_bd270fb89e87bee1ff25383bec637852.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c05fd9f-fd88-5a6c-9209-8712a0276f76/4c05fd9f-fd88-5a6c-9209-8712a0276f76_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728f691390326b71f377784e7ea7b5f/pa/UB75333_47241467877175a850783359bd6c7b2f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-18',
'seats_number': 5,
'seller_name': None,
'title': "Kia cee'd 1.0 TGDI Tech",
'transmission': 'manual',
'trim': 'Tech',
'year': 2018}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB75333%27 HTTP/1.1" 200 None
2026-01-29 06:01:31 [auto1.es] INFO: Saving data for UB75333: {'created_time': 1769666491.647504, 'last_price_update_time': 1769666491.647516, 'auction_closing_time': 1769703220.0}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB75333') HTTP/1.1" 204 0
2026-01-29 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24dc9168-6481-5ce4-8e92-5e207cf66a21 with identifier: JC52859
2026-01-29 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24dc9168-6481-5ce4-8e92-5e207cf66a21 with identifier: JC52859
2026-01-29 06:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24dc9168-6481-5ce4-8e92-5e207cf66a21 with identifier: JC52859 to the API
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC52859>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:10:34Z',
'fuel_type': 'petrol',
'id': '24dc9168-6481-5ce4-8e92-5e207cf66a21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC52859',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'make': 'Ford',
'model': 'Kuga',
'odometer': 21744,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2022}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC52859%27 HTTP/1.1" 200 None
2026-01-29 06:01:31 [auto1.es] INFO: Saving data for JC52859: {'auction_closing_time': 1769703034.0, 'created_time': 1768912684.386671, 'last_price_update_time': 1769666491.966168}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JC52859') HTTP/1.1" 204 0
2026-01-29 06:01:31 [auto1.es] INFO: Found listing with ID: LW64102
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW64102%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for LW64102: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: EM95708
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM95708%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for EM95708: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: BC35666
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC35666%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for BC35666: 2
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1f4750>
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_3b20b19e3be600e186c4eb6cdca6f944.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3b20b19e3be600e186c4eb6cdca6f944.jpg saved to cache
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: EM06663
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM06663%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for EM06663: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: KY09670
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY09670%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for KY09670: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: YU78532
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU78532%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for YU78532: 2
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: FP86933
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP86933%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for FP86933: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: PK59036
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK59036%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for PK59036: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: SW12423
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW12423%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for SW12423: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: JG40815
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG40815%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for JG40815: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: UG23726
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG23726%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for UG23726: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: XP82584
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP82584%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for XP82584: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: AM59619
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM59619%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for AM59619: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: WP71520
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP71520%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for WP71520: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: HA61855
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA61855%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for HA61855: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: XL84639
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL84639%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for XL84639: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: GC76681
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC76681%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for GC76681: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: YC50335
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC50335%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for YC50335: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: SM01483
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM01483%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for SM01483: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: VA43788
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA43788%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for VA43788: 2
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH19124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: PU03197
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU03197%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for PU03197: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: JC35569
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC35569%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for JC35569: 2
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT63528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA59266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU77878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA35771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF24269/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: RL43242
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL43242%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for RL43242: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: NN20547
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN20547%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for NN20547: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: DM90018
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM90018%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for DM90018: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: NT71551
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT71551%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for NT71551: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: AB95779
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB95779%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for AB95779: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: HC46230
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC46230%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for HC46230: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: GP26464
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP26464%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for GP26464: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: WM01102
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM01102%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.es] INFO: Scrape type for WM01102: 0
2026-01-29 06:01:32 [auto1.es] INFO: Found listing with ID: BE20116
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE20116%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for BE20116: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: TB21546
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB21546%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for TB21546: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: UG26866
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG26866%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for UG26866: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: UM59294
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM59294%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for UM59294: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: EH57940
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH57940%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for EH57940: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: YN30310
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN30310%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for YN30310: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: NS64232
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS64232%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for NS64232: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: NX00377
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX00377%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for NX00377: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: NM57420
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM57420%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for NM57420: 0
2026-01-29 06:01:33 [auto1.es] INFO: Found listing with ID: VF55204
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF55204%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Scrape type for VF55204: 0
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW22708> (referer: https://www.auto1.com/v1/car-details-view/XW22708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD97455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a650d1-f95d-5e11-806e-12b1dbd1f6e8 with identifier: XW22708
2026-01-29 06:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a650d1-f95d-5e11-806e-12b1dbd1f6e8 with scrape type 2
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a650d1-f95d-5e11-806e-12b1dbd1f6e8 with scrape type 2
2026-01-29 06:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3a650d1-f95d-5e11-806e-12b1dbd1f6e8, identifier: XW22708
2026-01-29 06:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3a650d1-f95d-5e11-806e-12b1dbd1f6e8 with identifier: XW22708
2026-01-29 06:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3a650d1-f95d-5e11-806e-12b1dbd1f6e8 with identifier: XW22708
2026-01-29 06:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3a650d1-f95d-5e11-806e-12b1dbd1f6e8 with identifier: XW22708 to the API
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW22708>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-29T16:27:22Z',
'fuel_type': 'petrol',
'id': 'f3a650d1-f95d-5e11-806e-12b1dbd1f6e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW22708',
'listing': 'auction',
'location': 'ES, Alzira',
'make': 'Fiat',
'model': '500',
'odometer': 49508,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2021}
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW22708%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.es] INFO: Saving data for XW22708: {'auction_closing_time': 1769704042.0, 'created_time': 1769533467.147503, 'last_price_update_time': 1769666493.650391}
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XW22708') HTTP/1.1" 204 0
2026-01-29 06:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c9b2d0>
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8b%252Ff58b048862d24a8dacaa6792e0383958%252Fpa%252FUZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg saved to cache
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f43e05f-5eac-558e-80a6-feb09add77ea
2026-01-29 06:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f43e05f-5eac-558e-80a6-feb09add77ea, skipping ID generation
2026-01-29 06:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f43e05f-5eac-558e-80a6-feb09add77ea with scrape type 1
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f43e05f-5eac-558e-80a6-feb09add77ea from tracking dictionaries
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f43e05f-5eac-558e-80a6-feb09add77ea sending to next pipeline
2026-01-29 06:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f43e05f-5eac-558e-80a6-feb09add77ea, identifier: UZ84215
2026-01-29 06:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f43e05f-5eac-558e-80a6-feb09add77ea with identifier: UZ84215
2026-01-29 06:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f43e05f-5eac-558e-80a6-feb09add77ea with identifier: UZ84215
2026-01-29 06:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f43e05f-5eac-558e-80a6-feb09add77ea with identifier: UZ84215 to the API
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:40:48Z',
'fuel_type': 'diesel',
'id': '1f43e05f-5eac-558e-80a6-feb09add77ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ84215',
'listing': 'auction',
'location': 'ES, Blanes',
'make': 'Ford',
'model': 'Kuga',
'odometer': 90631,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2812677,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_042f6ead2a6ffccff65cadef84ba9e19.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3b20b19e3be600e186c4eb6cdca6f944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_18ac83ad756f5a1fb531ca61f01c4c20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_8c8727bad5a3d97d358358411e62a8c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2717974,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_ffa6fe372ca0232edeb2379ac7c889cf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_23c79689df8a3c4a857d12658a0b727f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_48e2618745fd618a74f1a16a4ada7990.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_af05208a998f1aaa35c7e2dfab1a0141.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_3a9f2722a759c78617127b563167738f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_e6de76b6a4deccafed9e3947938c572e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96cbbae3f72cb267afa4fa98f01d731b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_96481889c9ba2bf778a7229be2d4baf1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_316b464883014dbf95838a050df400c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_4453cedcca4a0317d3f63707cb1eb1ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_1f4bf81d9e71009ab6fae52164c8faae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f43e05f-5eac-558e-80a6-feb09add77ea/1f43e05f-5eac-558e-80a6-feb09add77ea_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8b/f58b048862d24a8dacaa6792e0383958/pa/UZ84215_45e2a6f8d688cf555aca78eabe23e882.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2017}
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ84215%27 HTTP/1.1" 200 None
2026-01-29 06:01:34 [auto1.es] INFO: Saving data for UZ84215: {'created_time': 1769666494.645231, 'last_price_update_time': 1769666494.645245, 'auction_closing_time': 1769704848.0}
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ84215') HTTP/1.1" 204 0
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF61793> (referer: https://www.auto1.com/v1/car-details-view/XF61793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW61635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b9c5c0-fc7f-5741-b2c2-631520708881 with identifier: XF61793
2026-01-29 06:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b9c5c0-fc7f-5741-b2c2-631520708881 with scrape type 2
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43b9c5c0-fc7f-5741-b2c2-631520708881 with scrape type 2
2026-01-29 06:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 43b9c5c0-fc7f-5741-b2c2-631520708881, identifier: XF61793
2026-01-29 06:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 43b9c5c0-fc7f-5741-b2c2-631520708881 with identifier: XF61793
2026-01-29 06:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 43b9c5c0-fc7f-5741-b2c2-631520708881 with identifier: XF61793
2026-01-29 06:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 43b9c5c0-fc7f-5741-b2c2-631520708881 with identifier: XF61793 to the API
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XF61793>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-01-29T16:10:28Z',
'fuel_type': 'petrol',
'id': '43b9c5c0-fc7f-5741-b2c2-631520708881',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF61793',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Smart',
'model': 'fortwo',
'odometer': 19437,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-10',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF61793%27 HTTP/1.1" 200 None
2026-01-29 06:01:35 [auto1.es] INFO: Saving data for XF61793: {'auction_closing_time': 1769703028.0, 'created_time': 1769002778.306557, 'last_price_update_time': 1769666495.797859}
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XF61793') HTTP/1.1" 204 0
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC08636> (referer: https://www.auto1.com/v1/car-details-view/CC08636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE35950> (referer: https://www.auto1.com/v1/car-details-view/HE35950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV57144> (referer: https://www.auto1.com/v1/car-details-view/CV57144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT82415> (referer: https://www.auto1.com/v1/car-details-view/VT82415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA43788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE10228> (referer: https://www.auto1.com/v1/car-details-view/AE10228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a35ecec-1238-5ea2-af33-bdcd613ceade with identifier: CC08636
2026-01-29 06:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a35ecec-1238-5ea2-af33-bdcd613ceade with scrape type 2
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a35ecec-1238-5ea2-af33-bdcd613ceade with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0a35ecec-1238-5ea2-af33-bdcd613ceade, identifier: CC08636
2026-01-29 06:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078e053d-3149-572c-8f72-d233efbbcf4c with identifier: HE35950
2026-01-29 06:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078e053d-3149-572c-8f72-d233efbbcf4c with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 078e053d-3149-572c-8f72-d233efbbcf4c with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 078e053d-3149-572c-8f72-d233efbbcf4c, identifier: HE35950
2026-01-29 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0a35ecec-1238-5ea2-af33-bdcd613ceade with identifier: CC08636
2026-01-29 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0a35ecec-1238-5ea2-af33-bdcd613ceade with identifier: CC08636
2026-01-29 06:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0a35ecec-1238-5ea2-af33-bdcd613ceade with identifier: CC08636 to the API
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC08636>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:22:49Z',
'fuel_type': 'petrol',
'id': '0a35ecec-1238-5ea2-af33-bdcd613ceade',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC08636',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 57988,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2020}
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC08636%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.es] INFO: Saving data for CC08636: {'auction_closing_time': 1769703769.0, 'created_time': 1769580035.280246, 'last_price_update_time': 1769666496.440167}
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CC08636') HTTP/1.1" 204 0
2026-01-29 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 078e053d-3149-572c-8f72-d233efbbcf4c with identifier: HE35950
2026-01-29 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 078e053d-3149-572c-8f72-d233efbbcf4c with identifier: HE35950
2026-01-29 06:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 078e053d-3149-572c-8f72-d233efbbcf4c with identifier: HE35950 to the API
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE35950>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:08:33Z',
'fuel_type': 'petrol',
'id': '078e053d-3149-572c-8f72-d233efbbcf4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE35950',
'listing': 'auction',
'location': 'ES, Aldaya',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 24895,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Altitude',
'transmission': 'manual',
'trim': 'Altitude',
'year': 2023}
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE35950%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.es] INFO: Saving data for HE35950: {'auction_closing_time': 1769702913.0, 'created_time': 1769533427.615881, 'last_price_update_time': 1769666496.743701}
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HE35950') HTTP/1.1" 204 0
2026-01-29 06:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a9f6e1-3a78-52eb-a736-66a786dab849 with identifier: CV57144
2026-01-29 06:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a9f6e1-3a78-52eb-a736-66a786dab849 with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a9f6e1-3a78-52eb-a736-66a786dab849 with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4a9f6e1-3a78-52eb-a736-66a786dab849, identifier: CV57144
2026-01-29 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4a9f6e1-3a78-52eb-a736-66a786dab849 with identifier: CV57144
2026-01-29 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4a9f6e1-3a78-52eb-a736-66a786dab849 with identifier: CV57144
2026-01-29 06:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4a9f6e1-3a78-52eb-a736-66a786dab849 with identifier: CV57144 to the API
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV57144>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:46:47Z',
'fuel_type': 'petrol',
'id': 'c4a9f6e1-3a78-52eb-a736-66a786dab849',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV57144',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'make': 'Jeep',
'model': 'Compass',
'odometer': 52845,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Longitude Business FWD',
'transmission': 'automatic',
'trim': 'Longitude Business FWD',
'year': 2023}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV57144%27 HTTP/1.1" 200 None
2026-01-29 06:01:37 [auto1.es] INFO: Saving data for CV57144: {'auction_closing_time': 1769705207.0, 'created_time': 1767805441.988055, 'last_price_update_time': 1769666497.155767}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV57144') HTTP/1.1" 204 0
2026-01-29 06:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2bf399-dea5-56dd-9485-4ae2b061b111 with identifier: VT82415
2026-01-29 06:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2bf399-dea5-56dd-9485-4ae2b061b111 with scrape type 2
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2bf399-dea5-56dd-9485-4ae2b061b111 with scrape type 2
2026-01-29 06:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec2bf399-dea5-56dd-9485-4ae2b061b111, identifier: VT82415
2026-01-29 06:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68202215-bff9-5408-8587-d72222554358 with identifier: AE10228
2026-01-29 06:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68202215-bff9-5408-8587-d72222554358 with scrape type 2
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68202215-bff9-5408-8587-d72222554358 with scrape type 2
2026-01-29 06:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68202215-bff9-5408-8587-d72222554358, identifier: AE10228
2026-01-29 06:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec2bf399-dea5-56dd-9485-4ae2b061b111 with identifier: VT82415
2026-01-29 06:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec2bf399-dea5-56dd-9485-4ae2b061b111 with identifier: VT82415
2026-01-29 06:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'alpine a110 1.8 tce pure', 'price': 0, 'currency': 'eur', 'make': 'alpine', 'model': 'a110', 'transmission': 'automatic', 'odometer': 19945, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt82415', 'expiration_date': '2026-01-29t16:02:35z', 'origin_country_code': 'es', 'trim': 'pure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 252, 'doors_number': 2, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.8l', 'location': 'es, madrid', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': 'ec2bf399-dea5-56dd-9485-4ae2b061b111', 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'alpine a110', 'sanitized_make': 'alpine', 'odometer_in_km': 19945}
Failed validating None in schema:
False
On instance:
{'age_in_months': 51,
'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 2,
'emission_standard': 'euro 6',
'engine': '1.8l',
'engine_horse_power': 252,
'expiration_date': '2026-01-29t16:02:35z',
'fuel_type': 'petrol',
'id': 'ec2bf399-dea5-56dd-9485-4ae2b061b111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt82415',
'listing': 'auction',
'location': 'es, madrid',
'make': 'alpine',
'make_model': 'alpine a110',
'model': 'a110',
'odometer': 19945,
'odometer_in_km': 19945,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-13',
'sanitized_make': 'alpine',
'seats_number': 2,
'seller_name': None,
'title': 'alpine a110 1.8 tce pure',
'transmission': 'automatic',
'trim': 'pure',
'year': 2021}
2026-01-29 06:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: ec2bf399-dea5-56dd-9485-4ae2b061b111 spider: auto1.es
2026-01-29 06:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ec2bf399-dea5-56dd-9485-4ae2b061b111 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'alpine a110 1.8 tce pure', 'price': 0, 'currency': 'eur', 'make': 'alpine', 'model': 'a110', 'transmission': 'automatic', 'odometer': 19945, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt82415', 'expiration_date': '2026-01-29t16:02:35z', 'origin_country_code': 'es', 'trim': 'pure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 252, 'doors_number': 2, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.8l', 'location': 'es, madrid', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': 'ec2bf399-dea5-56dd-9485-4ae2b061b111', 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'alpine a110', 'sanitized_make': 'alpine', 'odometer_in_km': 19945}
Failed validating None in schema:
False
On instance:
{'age_in_months': 51,
'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 2,
'emission_standard': 'euro 6',
'engine': '1.8l',
'engine_horse_power': 252,
'expiration_date': '2026-01-29t16:02:35z',
'fuel_type': 'petrol',
'id': 'ec2bf399-dea5-56dd-9485-4ae2b061b111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt82415',
'listing': 'auction',
'location': 'es, madrid',
'make': 'alpine',
'make_model': 'alpine a110',
'model': 'a110',
'odometer': 19945,
'odometer_in_km': 19945,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-13',
'sanitized_make': 'alpine',
'seats_number': 2,
'seller_name': None,
'title': 'alpine a110 1.8 tce pure',
'transmission': 'automatic',
'trim': 'pure',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 252,
'expiration_date': '2026-01-29T16:02:35Z',
'fuel_type': 'petrol',
'id': 'ec2bf399-dea5-56dd-9485-4ae2b061b111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT82415',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Alpine',
'model': 'A110',
'odometer': 19945,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-13',
'seats_number': 2,
'seller_name': None,
'title': 'Alpine A110 1.8 TCe Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2021}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT82415%27 HTTP/1.1" 200 None
2026-01-29 06:01:37 [auto1.es] INFO: Saving data for VT82415: {'auction_closing_time': 1769702555.0, 'created_time': 1769533458.623615, 'last_price_update_time': 1769666497.567662}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT82415') HTTP/1.1" 204 0
2026-01-29 06:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68202215-bff9-5408-8587-d72222554358 with identifier: AE10228
2026-01-29 06:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68202215-bff9-5408-8587-d72222554358 with identifier: AE10228
2026-01-29 06:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68202215-bff9-5408-8587-d72222554358 with identifier: AE10228 to the API
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE10228>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:04:32Z',
'fuel_type': 'petrol',
'id': '68202215-bff9-5408-8587-d72222554358',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE10228',
'listing': 'auction',
'location': 'ES, Valencia',
'make': 'Seat',
'model': 'Leon',
'odometer': 78579,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.5 TSI ACT FR Edition',
'transmission': 'manual',
'trim': 'FR Edition',
'year': 2019}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE10228%27 HTTP/1.1" 200 None
2026-01-29 06:01:37 [auto1.es] INFO: Saving data for AE10228: {'auction_closing_time': 1769702672.0, 'created_time': 1769533479.564463, 'last_price_update_time': 1769666497.870892}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE10228') HTTP/1.1" 204 0
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU78532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC35569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA59266> (referer: https://www.auto1.com/v1/car-details-view/GA59266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA35771> (referer: https://www.auto1.com/v1/car-details-view/RA35771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU77878> (referer: https://www.auto1.com/v1/car-details-view/HU77878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4521159-a366-5a3d-9a55-680ddafbd178 with identifier: GA59266
2026-01-29 06:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4521159-a366-5a3d-9a55-680ddafbd178 with scrape type 2
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4521159-a366-5a3d-9a55-680ddafbd178 with scrape type 2
2026-01-29 06:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4521159-a366-5a3d-9a55-680ddafbd178, identifier: GA59266
2026-01-29 06:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4521159-a366-5a3d-9a55-680ddafbd178 with identifier: GA59266
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4521159-a366-5a3d-9a55-680ddafbd178 with identifier: GA59266
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b4521159-a366-5a3d-9a55-680ddafbd178 spider: auto1.es
2026-01-29 06:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b4521159-a366-5a3d-9a55-680ddafbd178 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6A',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:25:01Z',
'fuel_type': 'diesel',
'id': 'b4521159-a366-5a3d-9a55-680ddafbd178',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA59266',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 75146,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Jahre Edition',
'transmission': 'manual',
'trim': '20 Jahre Edition',
'year': 2017}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA59266%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.es] INFO: Saving data for GA59266: {'auction_closing_time': 1769703901.0, 'created_time': 1769580072.344655, 'last_price_update_time': 1769666498.31612}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GA59266') HTTP/1.1" 204 0
2026-01-29 06:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF24269> (referer: https://www.auto1.com/v1/car-details-view/TF24269/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC35666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5 with identifier: RA35771
2026-01-29 06:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5 with scrape type 2
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5 with scrape type 2
2026-01-29 06:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5, identifier: RA35771
2026-01-29 06:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c99c34e-658d-5c66-9d25-05565af34e50 with identifier: HU77878
2026-01-29 06:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c99c34e-658d-5c66-9d25-05565af34e50 with scrape type 1
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_0ebae0f79cc592087b8e89e37b143df9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_0ebae0f79cc592087b8e89e37b143df9.jpg not downloaded yet
2026-01-29 06:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5 with identifier: RA35771
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5 with identifier: RA35771
2026-01-29 06:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f7b3b98-1d37-5ded-a997-7b930c9fd9c5 with identifier: RA35771 to the API
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA35771>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': 'Rental',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-01-29T16:48:04Z',
'fuel_type': 'diesel',
'id': '9f7b3b98-1d37-5ded-a997-7b930c9fd9c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA35771',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 87867,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.2 JTDM Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2018}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA35771%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.es] INFO: Saving data for RA35771: {'auction_closing_time': 1769705284.0, 'created_time': 1769533416.851862, 'last_price_update_time': 1769666498.759875}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA35771') HTTP/1.1" 204 0
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_1d0e6b44d4ec7030f22edea5767bed39.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_1d0e6b44d4ec7030f22edea5767bed39.jpg not downloaded yet
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_01e9e0a1d7060b8037d4d0986c9fe5c5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_01e9e0a1d7060b8037d4d0986c9fe5c5.jpg not downloaded yet
2026-01-29 06:01:38 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fcaa570-36a2-5932-bff7-a507e7d8e53a with identifier: TF24269
2026-01-29 06:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fcaa570-36a2-5932-bff7-a507e7d8e53a with scrape type 1
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6fcaa570-36a2-5932-bff7-a507e7d8e53a
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_5adc6a5207f39dee4fb36bbe4c4f996f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_5adc6a5207f39dee4fb36bbe4c4f996f.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_991074f3321eb6b9b63f2b18bdcf30bb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_991074f3321eb6b9b63f2b18bdcf30bb.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_9c3b6a6c4960f82e399c7daf15a4c090.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_9c3b6a6c4960f82e399c7daf15a4c090.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_0f2efd181d8c9066c3cb3a41469e05d1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_0f2efd181d8c9066c3cb3a41469e05d1.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_bb61ebacefcf1609e8831faec4102039.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_bb61ebacefcf1609e8831faec4102039.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_3020fe38689de0f1044ae36b502a85f8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_3020fe38689de0f1044ae36b502a85f8.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_53c7a01e392c2791d62b198ab952dd14.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_53c7a01e392c2791d62b198ab952dd14.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_9850be85984a0dd4bdecb7ef28d36c4d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_9850be85984a0dd4bdecb7ef28d36c4d.jpg already downloaded
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_e60db2795d3860f5aaa56e0f29533b88.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_e60db2795d3860f5aaa56e0f29533b88.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_93ddd43989d4f2419246caa5443a9722.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_93ddd43989d4f2419246caa5443a9722.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_4e7bf6d3b5fcf7c5e662670b0c115755.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_4e7bf6d3b5fcf7c5e662670b0c115755.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_e27d4bf8c10ec0febbe5e5fb74dc6908.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_e27d4bf8c10ec0febbe5e5fb74dc6908.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_db2560f85dd536f3cfc6746fa8f2ad59.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_db2560f85dd536f3cfc6746fa8f2ad59.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_65ea9db1041672e19e7d5d39bdc9b166.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_65ea9db1041672e19e7d5d39bdc9b166.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_8de1e9f9034da93a6c0953450cf9634a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_8de1e9f9034da93a6c0953450cf9634a.jpg already downloaded
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F14%252F5f142c6a0dde5b0595a71c70fe4adea6%252Fpa%252FTF24269_c7ff752ee7d24ae49a3ef0a8d4bbcd9c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_c7ff752ee7d24ae49a3ef0a8d4bbcd9c.jpg already downloaded
2026-01-29 06:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6fcaa570-36a2-5932-bff7-a507e7d8e53a, identifier: TF24269
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_b90f329777dbe28b6f905c4024368218.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_b90f329777dbe28b6f905c4024368218.jpg not downloaded yet
2026-01-29 06:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6fcaa570-36a2-5932-bff7-a507e7d8e53a with identifier: TF24269
2026-01-29 06:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6fcaa570-36a2-5932-bff7-a507e7d8e53a with identifier: TF24269
2026-01-29 06:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6fcaa570-36a2-5932-bff7-a507e7d8e53a with identifier: TF24269 to the API
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF24269>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 163,
'expiration_date': '2026-01-29T16:44:13Z',
'fuel_type': 'petrol',
'id': '6fcaa570-36a2-5932-bff7-a507e7d8e53a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF24269',
'listing': 'auction',
'location': 'ES, El Carpio',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 77898,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_5adc6a5207f39dee4fb36bbe4c4f996f.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_991074f3321eb6b9b63f2b18bdcf30bb.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_9c3b6a6c4960f82e399c7daf15a4c090.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_0f2efd181d8c9066c3cb3a41469e05d1.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_bb61ebacefcf1609e8831faec4102039.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_3020fe38689de0f1044ae36b502a85f8.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_53c7a01e392c2791d62b198ab952dd14.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_9850be85984a0dd4bdecb7ef28d36c4d.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_e60db2795d3860f5aaa56e0f29533b88.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_93ddd43989d4f2419246caa5443a9722.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_4e7bf6d3b5fcf7c5e662670b0c115755.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_e27d4bf8c10ec0febbe5e5fb74dc6908.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_db2560f85dd536f3cfc6746fa8f2ad59.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_65ea9db1041672e19e7d5d39bdc9b166.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_8de1e9f9034da93a6c0953450cf9634a.jpg',
'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_c7ff752ee7d24ae49a3ef0a8d4bbcd9c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_5adc6a5207f39dee4fb36bbe4c4f996f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_991074f3321eb6b9b63f2b18bdcf30bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_9c3b6a6c4960f82e399c7daf15a4c090.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_0f2efd181d8c9066c3cb3a41469e05d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_bb61ebacefcf1609e8831faec4102039.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_3020fe38689de0f1044ae36b502a85f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_53c7a01e392c2791d62b198ab952dd14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_9850be85984a0dd4bdecb7ef28d36c4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_e60db2795d3860f5aaa56e0f29533b88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_93ddd43989d4f2419246caa5443a9722.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_4e7bf6d3b5fcf7c5e662670b0c115755.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_e27d4bf8c10ec0febbe5e5fb74dc6908.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_db2560f85dd536f3cfc6746fa8f2ad59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_65ea9db1041672e19e7d5d39bdc9b166.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_8de1e9f9034da93a6c0953450cf9634a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcaa570-36a2-5932-bff7-a507e7d8e53a/6fcaa570-36a2-5932-bff7-a507e7d8e53a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/14/5f142c6a0dde5b0595a71c70fe4adea6/pa/TF24269_c7ff752ee7d24ae49a3ef0a8d4bbcd9c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF24269%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Saving data for TF24269: {'created_time': 1769666499.574097, 'last_price_update_time': 1769666499.574109, 'auction_closing_time': 1769705053.0}
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF24269') HTTP/1.1" 204 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: YR74795
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR74795%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for YR74795: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: FG84665
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG84665%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for FG84665: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: PX39170
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX39170%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for PX39170: 2
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_0ebae0f79cc592087b8e89e37b143df9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_98b3d1a0cc5ab8e24484ef779a9c752a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_98b3d1a0cc5ab8e24484ef779a9c752a.jpg not downloaded yet
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT63528> (referer: https://www.auto1.com/v1/car-details-view/CT63528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH19124> (referer: https://www.auto1.com/v1/car-details-view/JH19124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD97455> (referer: https://www.auto1.com/v1/car-details-view/KD97455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: NZ57832
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ57832%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for NZ57832: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: XU57331
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU57331%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for XU57331: 2
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_9db00f5227265344138f448f28cd173b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9db00f5227265344138f448f28cd173b.jpg not downloaded yet
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA43788> (referer: https://www.auto1.com/v1/car-details-view/VA43788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW61635> (referer: https://www.auto1.com/v1/car-details-view/JW61635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: YY25226
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY25226%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for YY25226: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: ZR58264
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for ZR58264: 2
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_57176fde251cba0261d7047a7dc19a36.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_57176fde251cba0261d7047a7dc19a36.jpg not downloaded yet
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_1d0e6b44d4ec7030f22edea5767bed39.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: KS16688
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS16688%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for KS16688: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: AZ08882
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ08882%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for AZ08882: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: YE07750
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE07750%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for YE07750: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: JF24030
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF24030%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for JF24030: 2
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_eb7ec9f4415386d8c7ab226cf4583e56.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_eb7ec9f4415386d8c7ab226cf4583e56.jpg not downloaded yet
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_b90f329777dbe28b6f905c4024368218.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: WF73156
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF73156%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for WF73156: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: BV39192
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV39192%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for BV39192: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: UN87696
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN87696%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.es] INFO: Scrape type for UN87696: 0
2026-01-29 06:01:39 [auto1.es] INFO: Found listing with ID: XC49329
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC49329%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.es] INFO: Scrape type for XC49329: 0
2026-01-29 06:01:40 [auto1.es] INFO: Found listing with ID: VH95267
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH95267%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.es] INFO: Scrape type for VH95267: 0
2026-01-29 06:01:40 [auto1.es] INFO: Found listing with ID: PX86419
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX86419%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.es] INFO: Scrape type for PX86419: 0
2026-01-29 06:01:40 [auto1.es] INFO: Found listing with ID: YD94145
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD94145%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.es] INFO: Scrape type for YD94145: 0
2026-01-29 06:01:40 [auto1.es] INFO: Found listing with ID: MY67212
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY67212%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.es] INFO: Scrape type for MY67212: 0
2026-01-29 06:01:40 [auto1.es] INFO: Found listing with ID: KG36099
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG36099%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.es] INFO: Scrape type for KG36099: 2
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655cd2490>
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_0ebae0f79cc592087b8e89e37b143df9.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_0ebae0f79cc592087b8e89e37b143df9.jpg saved to cache
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2079ba5-565b-59ca-8d0f-7c4f8a033fb6 with identifier: CT63528
2026-01-29 06:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2079ba5-565b-59ca-8d0f-7c4f8a033fb6 with scrape type 1
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a2079ba5-565b-59ca-8d0f-7c4f8a033fb6
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_ee8abee2c816baba354fb0bda3b47aca.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_ee8abee2c816baba354fb0bda3b47aca.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_dc550332aefd5031f4f8e21079b4993f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_dc550332aefd5031f4f8e21079b4993f.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_7e5c4f1cfaa3872b092de27ee8ab355c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_7e5c4f1cfaa3872b092de27ee8ab355c.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_5613e2de3a9b9e68c807588b0da34b7e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_5613e2de3a9b9e68c807588b0da34b7e.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_1f119d13508522e570593233de698ca4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_1f119d13508522e570593233de698ca4.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_6df3d3c1179eaf04dd9ce61f9fba1eeb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_6df3d3c1179eaf04dd9ce61f9fba1eeb.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_bcc84b72500a149563057fb183046552.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_bcc84b72500a149563057fb183046552.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_955c0b7a86ff9ca83cc2e4c7e488465a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_955c0b7a86ff9ca83cc2e4c7e488465a.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_75408a4b31d840f2330c1d831ab7ed58.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_75408a4b31d840f2330c1d831ab7ed58.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_4139baf7a8d4562a83e1ecab8df68304.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_4139baf7a8d4562a83e1ecab8df68304.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_acbf1ec9a0cc3db6ef8ebf00db2bbd2d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_acbf1ec9a0cc3db6ef8ebf00db2bbd2d.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_2703bfe3b89816e1cc52b677df8c9533.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_2703bfe3b89816e1cc52b677df8c9533.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_4d80e9d1957dba17a4cbd397be301021.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_4d80e9d1957dba17a4cbd397be301021.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_0d209df842f60e897818fb01cba72827.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_0d209df842f60e897818fb01cba72827.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_8637eb23d8d3c64b59f67c3069072795.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_8637eb23d8d3c64b59f67c3069072795.jpg already downloaded
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc9%252F6dc975c2ffb9e28c1471647436962b82%252Fpa%252FCT63528_b07df00a6f597934f8bbd58e0afeb8bc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_b07df00a6f597934f8bbd58e0afeb8bc.jpg already downloaded
2026-01-29 06:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2079ba5-565b-59ca-8d0f-7c4f8a033fb6, identifier: CT63528
2026-01-29 06:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1889f9-2327-5770-97a8-95523a849bd7 with identifier: JH19124
2026-01-29 06:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1889f9-2327-5770-97a8-95523a849bd7 with scrape type 2
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b1889f9-2327-5770-97a8-95523a849bd7 with scrape type 2
2026-01-29 06:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b1889f9-2327-5770-97a8-95523a849bd7, identifier: JH19124
2026-01-29 06:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2786307-39ee-59fb-9ec1-212f2e696c5c with identifier: KD97455
2026-01-29 06:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2786307-39ee-59fb-9ec1-212f2e696c5c with scrape type 2
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2786307-39ee-59fb-9ec1-212f2e696c5c with scrape type 2
2026-01-29 06:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2786307-39ee-59fb-9ec1-212f2e696c5c, identifier: KD97455
2026-01-29 06:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_98b3d1a0cc5ab8e24484ef779a9c752a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_5e98bcfbac81df15d9e6df90bf7267d2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5e98bcfbac81df15d9e6df90bf7267d2.jpg not downloaded yet
2026-01-29 06:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2079ba5-565b-59ca-8d0f-7c4f8a033fb6 with identifier: CT63528
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2079ba5-565b-59ca-8d0f-7c4f8a033fb6 with identifier: CT63528
2026-01-29 06:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2079ba5-565b-59ca-8d0f-7c4f8a033fb6 with identifier: CT63528 to the API
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CT63528>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2026-01-29T16:18:18Z',
'fuel_type': 'diesel',
'id': 'a2079ba5-565b-59ca-8d0f-7c4f8a033fb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT63528',
'listing': 'auction',
'location': 'ES, Vilafranca del Penedès, Barcelona',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 128414,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_ee8abee2c816baba354fb0bda3b47aca.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_dc550332aefd5031f4f8e21079b4993f.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_7e5c4f1cfaa3872b092de27ee8ab355c.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_5613e2de3a9b9e68c807588b0da34b7e.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_1f119d13508522e570593233de698ca4.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_6df3d3c1179eaf04dd9ce61f9fba1eeb.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_bcc84b72500a149563057fb183046552.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_955c0b7a86ff9ca83cc2e4c7e488465a.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_75408a4b31d840f2330c1d831ab7ed58.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_4139baf7a8d4562a83e1ecab8df68304.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_acbf1ec9a0cc3db6ef8ebf00db2bbd2d.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_2703bfe3b89816e1cc52b677df8c9533.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_4d80e9d1957dba17a4cbd397be301021.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_0d209df842f60e897818fb01cba72827.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_8637eb23d8d3c64b59f67c3069072795.jpg',
'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_b07df00a6f597934f8bbd58e0afeb8bc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_ee8abee2c816baba354fb0bda3b47aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_dc550332aefd5031f4f8e21079b4993f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_7e5c4f1cfaa3872b092de27ee8ab355c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_5613e2de3a9b9e68c807588b0da34b7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_1f119d13508522e570593233de698ca4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_6df3d3c1179eaf04dd9ce61f9fba1eeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_bcc84b72500a149563057fb183046552.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_955c0b7a86ff9ca83cc2e4c7e488465a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_75408a4b31d840f2330c1d831ab7ed58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_4139baf7a8d4562a83e1ecab8df68304.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_acbf1ec9a0cc3db6ef8ebf00db2bbd2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_2703bfe3b89816e1cc52b677df8c9533.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_4d80e9d1957dba17a4cbd397be301021.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_0d209df842f60e897818fb01cba72827.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_8637eb23d8d3c64b59f67c3069072795.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2079ba5-565b-59ca-8d0f-7c4f8a033fb6/a2079ba5-565b-59ca-8d0f-7c4f8a033fb6_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/c9/6dc975c2ffb9e28c1471647436962b82/pa/CT63528_b07df00a6f597934f8bbd58e0afeb8bc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT63528%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.es] INFO: Saving data for CT63528: {'created_time': 1769666501.413368, 'last_price_update_time': 1769666501.41338, 'auction_closing_time': 1769703498.0}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT63528') HTTP/1.1" 204 0
2026-01-29 06:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b1889f9-2327-5770-97a8-95523a849bd7 with identifier: JH19124
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b1889f9-2327-5770-97a8-95523a849bd7 with identifier: JH19124
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1b1889f9-2327-5770-97a8-95523a849bd7 spider: auto1.es
2026-01-29 06:01:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1b1889f9-2327-5770-97a8-95523a849bd7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:46:07Z',
'fuel_type': 'diesel',
'id': '1b1889f9-2327-5770-97a8-95523a849bd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH19124',
'listing': 'auction',
'location': 'ES',
'make': 'Opel',
'model': 'Combo Life',
'odometer': 178065,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2021}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH19124%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.es] INFO: Saving data for JH19124: {'auction_closing_time': 1769705167.0, 'created_time': 1769533464.57989, 'last_price_update_time': 1769666501.73257}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JH19124') HTTP/1.1" 204 0
2026-01-29 06:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2786307-39ee-59fb-9ec1-212f2e696c5c with identifier: KD97455
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2786307-39ee-59fb-9ec1-212f2e696c5c with identifier: KD97455
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154779 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154779
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b2786307-39ee-59fb-9ec1-212f2e696c5c spider: auto1.es
2026-01-29 06:01:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b2786307-39ee-59fb-9ec1-212f2e696c5c due to rule: high_mileage_for_country.json, error: 154779 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154779
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-01-29T16:53:42Z',
'fuel_type': 'petrol',
'id': 'b2786307-39ee-59fb-9ec1-212f2e696c5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD97455',
'listing': 'auction',
'location': 'Elche',
'make': 'Renault',
'model': 'Megane',
'odometer': 154779,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2019}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD97455%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.es] INFO: Saving data for KD97455: {'auction_closing_time': 1769705622.0, 'created_time': 1769533329.711858, 'last_price_update_time': 1769666501.973359}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD97455') HTTP/1.1" 204 0
2026-01-29 06:01:41 [auto1.es] INFO: Found listing with ID: PE29984
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE29984%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for PE29984: 2
2026-01-29 06:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9af5eea9-32e5-5f54-ab5e-3efc88161327 with identifier: VA43788
2026-01-29 06:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9af5eea9-32e5-5f54-ab5e-3efc88161327 with scrape type 2
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9af5eea9-32e5-5f54-ab5e-3efc88161327 with scrape type 2
2026-01-29 06:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9af5eea9-32e5-5f54-ab5e-3efc88161327, identifier: VA43788
2026-01-29 06:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f587d234-6972-5962-909b-9c2f011fa15f with identifier: JW61635
2026-01-29 06:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f587d234-6972-5962-909b-9c2f011fa15f with scrape type 2
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f587d234-6972-5962-909b-9c2f011fa15f with scrape type 2
2026-01-29 06:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f587d234-6972-5962-909b-9c2f011fa15f, identifier: JW61635
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_01e9e0a1d7060b8037d4d0986c9fe5c5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9db00f5227265344138f448f28cd173b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_77a9a70174a6437a209edca4ccdcb818.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_77a9a70174a6437a209edca4ccdcb818.jpg not downloaded yet
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC35569> (referer: https://www.auto1.com/v1/car-details-view/JC35569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU78532> (referer: https://www.auto1.com/v1/car-details-view/YU78532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9af5eea9-32e5-5f54-ab5e-3efc88161327 with identifier: VA43788
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9af5eea9-32e5-5f54-ab5e-3efc88161327 with identifier: VA43788
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162502 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162502
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9af5eea9-32e5-5f54-ab5e-3efc88161327 spider: auto1.es
2026-01-29 06:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9af5eea9-32e5-5f54-ab5e-3efc88161327 due to rule: high_mileage_for_country.json, error: 162502 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162502
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-01-29T16:33:27Z',
'fuel_type': 'diesel',
'id': '9af5eea9-32e5-5f54-ab5e-3efc88161327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA43788',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Peugeot',
'model': '2008',
'odometer': 162502,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA43788%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Saving data for VA43788: {'auction_closing_time': 1769704407.0, 'created_time': 1767619762.667792, 'last_price_update_time': 1769666502.442871}
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VA43788') HTTP/1.1" 204 0
2026-01-29 06:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f587d234-6972-5962-909b-9c2f011fa15f with identifier: JW61635
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f587d234-6972-5962-909b-9c2f011fa15f with identifier: JW61635
2026-01-29 06:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f587d234-6972-5962-909b-9c2f011fa15f with identifier: JW61635 to the API
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JW61635>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-01-29T16:33:28Z',
'fuel_type': 'petrol',
'id': 'f587d234-6972-5962-909b-9c2f011fa15f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW61635',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 8266,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2023}
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW61635%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Saving data for JW61635: {'auction_closing_time': 1769704408.0, 'created_time': 1768825948.148923, 'last_price_update_time': 1769666502.790138}
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW61635') HTTP/1.1" 204 0
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_57176fde251cba0261d7047a7dc19a36.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:42 [auto1.es] INFO: Found listing with ID: DP66753
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP66753%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for DP66753: 0
2026-01-29 06:01:42 [auto1.es] INFO: Found listing with ID: GL75649
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL75649%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for GL75649: 0
2026-01-29 06:01:42 [auto1.es] INFO: Found listing with ID: KJ95887
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ95887%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for KJ95887: 0
2026-01-29 06:01:42 [auto1.es] INFO: Found listing with ID: AH55532
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH55532%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for AH55532: 0
2026-01-29 06:01:42 [auto1.es] INFO: Found listing with ID: LC75977
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC75977%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for LC75977: 0
2026-01-29 06:01:42 [auto1.es] INFO: Found listing with ID: GF40460
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF40460%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.es] INFO: Scrape type for GF40460: 2
2026-01-29 06:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c132490>
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_1d0e6b44d4ec7030f22edea5767bed39.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_1d0e6b44d4ec7030f22edea5767bed39.jpg saved to cache
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655cb26d0>
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_b90f329777dbe28b6f905c4024368218.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_b90f329777dbe28b6f905c4024368218.jpg saved to cache
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c3c8c90>
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_98b3d1a0cc5ab8e24484ef779a9c752a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_98b3d1a0cc5ab8e24484ef779a9c752a.jpg saved to cache
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_5fbda15cd5ed4ff3f2a0abc28c7bc3ac.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5fbda15cd5ed4ff3f2a0abc28c7bc3ac.jpg not downloaded yet
2026-01-29 06:01:43 [auto1.es] INFO: Found listing with ID: YM67211
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM67211%27 HTTP/1.1" 200 None
2026-01-29 06:01:43 [auto1.es] INFO: Scrape type for YM67211: 0
2026-01-29 06:01:43 [auto1.es] INFO: Found listing with ID: JE91492
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE91492%27 HTTP/1.1" 200 None
2026-01-29 06:01:43 [auto1.es] INFO: Scrape type for JE91492: 2
2026-01-29 06:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX39170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655e7fc50>
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_01e9e0a1d7060b8037d4d0986c9fe5c5.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_01e9e0a1d7060b8037d4d0986c9fe5c5.jpg saved to cache
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c1060d0>
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_9db00f5227265344138f448f28cd173b.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9db00f5227265344138f448f28cd173b.jpg saved to cache
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10c741a-ddd6-57dc-95e6-b6100ab8693e with identifier: JC35569
2026-01-29 06:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10c741a-ddd6-57dc-95e6-b6100ab8693e with scrape type 2
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10c741a-ddd6-57dc-95e6-b6100ab8693e with scrape type 2
2026-01-29 06:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f10c741a-ddd6-57dc-95e6-b6100ab8693e, identifier: JC35569
2026-01-29 06:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d679c54-e885-5020-95bf-c6c9faa98c30 with identifier: YU78532
2026-01-29 06:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d679c54-e885-5020-95bf-c6c9faa98c30 with scrape type 2
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d679c54-e885-5020-95bf-c6c9faa98c30 with scrape type 2
2026-01-29 06:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d679c54-e885-5020-95bf-c6c9faa98c30, identifier: YU78532
2026-01-29 06:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_eb7ec9f4415386d8c7ab226cf4583e56.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_c881901e2b8f91e5005580fdef2a1bfd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c881901e2b8f91e5005580fdef2a1bfd.jpg not downloaded yet
2026-01-29 06:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC35666> (referer: https://www.auto1.com/v1/car-details-view/BC35666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f10c741a-ddd6-57dc-95e6-b6100ab8693e with identifier: JC35569
2026-01-29 06:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f10c741a-ddd6-57dc-95e6-b6100ab8693e with identifier: JC35569
2026-01-29 06:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 81476, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jc35569', 'expiration_date': '2026-01-29t16:08:59z', 'origin_country_code': 'es', 'trim': 'c-series', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'f10c741a-ddd6-57dc-95e6-b6100ab8693e', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 81476}
Failed validating None in schema:
False
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2026-01-29t16:08:59z',
'fuel_type': 'petrol',
'id': 'f10c741a-ddd6-57dc-95e6-b6100ab8693e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jc35569',
'listing': 'auction',
'location': 'es, calaf - barcelona',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 81476,
'odometer_in_km': 81476,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-20',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2022}
2026-01-29 06:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f10c741a-ddd6-57dc-95e6-b6100ab8693e spider: auto1.es
2026-01-29 06:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f10c741a-ddd6-57dc-95e6-b6100ab8693e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 81476, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jc35569', 'expiration_date': '2026-01-29t16:08:59z', 'origin_country_code': 'es', 'trim': 'c-series', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'f10c741a-ddd6-57dc-95e6-b6100ab8693e', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 81476}
Failed validating None in schema:
False
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2026-01-29t16:08:59z',
'fuel_type': 'petrol',
'id': 'f10c741a-ddd6-57dc-95e6-b6100ab8693e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jc35569',
'listing': 'auction',
'location': 'es, calaf - barcelona',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 81476,
'odometer_in_km': 81476,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-20',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-01-29T16:08:59Z',
'fuel_type': 'petrol',
'id': 'f10c741a-ddd6-57dc-95e6-b6100ab8693e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC35569',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Citroen',
'model': 'C3',
'odometer': 81476,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech C-Series',
'transmission': 'manual',
'trim': 'C-Series',
'year': 2022}
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC35569%27 HTTP/1.1" 200 None
2026-01-29 06:01:44 [auto1.es] INFO: Saving data for JC35569: {'auction_closing_time': 1769702939.0, 'created_time': 1768401486.411114, 'last_price_update_time': 1769666504.919767}
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JC35569') HTTP/1.1" 204 0
2026-01-29 06:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d679c54-e885-5020-95bf-c6c9faa98c30 with identifier: YU78532
2026-01-29 06:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d679c54-e885-5020-95bf-c6c9faa98c30 with identifier: YU78532
2026-01-29 06:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city verso' containing 'proace'
2026-01-29 06:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9d679c54-e885-5020-95bf-c6c9faa98c30 spider: auto1.es
2026-01-29 06:01:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9d679c54-e885-5020-95bf-c6c9faa98c30 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city verso' containing 'proace'
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:53:51Z',
'fuel_type': 'diesel',
'id': '9d679c54-e885-5020-95bf-c6c9faa98c30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU78532',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Toyota',
'model': 'ProAce City Verso',
'odometer': 176919,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota ProAce City Verso 1.5 D-4D L1 Dynamic',
'transmission': 'manual',
'trim': 'L1 Dynamic',
'year': 2021}
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU78532%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Saving data for YU78532: {'auction_closing_time': 1769705631.0, 'created_time': 1769533404.486294, 'last_price_update_time': 1769666505.155149}
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU78532') HTTP/1.1" 204 0
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0657756250>
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_57176fde251cba0261d7047a7dc19a36.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_57176fde251cba0261d7047a7dc19a36.jpg saved to cache
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: NV32850
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV32850%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for NV32850: 2
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5e98bcfbac81df15d9e6df90bf7267d2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_74c204839bd3ee77954771fa528ca994.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_74c204839bd3ee77954771fa528ca994.jpg not downloaded yet
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU57331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR58264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF24030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_77a9a70174a6437a209edca4ccdcb818.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: ZL56858
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL56858%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for ZL56858: 0
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: YN46395
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN46395%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for YN46395: 0
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: DN85233
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN85233%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for DN85233: 0
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: TP36756
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP36756%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for TP36756: 0
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: VH21101
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH21101%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for VH21101: 0
2026-01-29 06:01:45 [auto1.es] INFO: Found listing with ID: SZ42428
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ42428%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.es] INFO: Scrape type for SZ42428: 2
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655c88e50>
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_eb7ec9f4415386d8c7ab226cf4583e56.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_eb7ec9f4415386d8c7ab226cf4583e56.jpg saved to cache
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b5ee03-0408-55b2-8512-503ba596f727 with identifier: BC35666
2026-01-29 06:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b5ee03-0408-55b2-8512-503ba596f727 with scrape type 2
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b5ee03-0408-55b2-8512-503ba596f727 with scrape type 2
2026-01-29 06:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51b5ee03-0408-55b2-8512-503ba596f727, identifier: BC35666
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_9e566256745b39f792df342414d46f46.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9e566256745b39f792df342414d46f46.jpg not downloaded yet
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: WS16949
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS16949%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for WS16949: 0
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: PS52157
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS52157%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for PS52157: 0
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: CR90298
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR90298%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for CR90298: 2
2026-01-29 06:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51b5ee03-0408-55b2-8512-503ba596f727 with identifier: BC35666
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51b5ee03-0408-55b2-8512-503ba596f727 with identifier: BC35666
2026-01-29 06:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51b5ee03-0408-55b2-8512-503ba596f727 with identifier: BC35666 to the API
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC35666>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-01-29T16:11:17Z',
'fuel_type': 'petrol',
'id': '51b5ee03-0408-55b2-8512-503ba596f727',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC35666',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 73478,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2018}
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC35666%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Saving data for BC35666: {'auction_closing_time': 1769703077.0, 'created_time': 1769446987.677361, 'last_price_update_time': 1769666506.554888}
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BC35666') HTTP/1.1" 204 0
2026-01-29 06:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5fbda15cd5ed4ff3f2a0abc28c7bc3ac.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: RB44600
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB44600%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for RB44600: 0
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: PS02868
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS02868%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for PS02868: 2
2026-01-29 06:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_c66e5c9cc094c6bb2320033e2d96512c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c66e5c9cc094c6bb2320033e2d96512c.jpg not downloaded yet
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: MP48653
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP48653%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for MP48653: 0
2026-01-29 06:01:46 [auto1.es] INFO: Found listing with ID: PF42386
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF42386%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.es] INFO: Scrape type for PF42386: 2
2026-01-29 06:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG36099/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE29984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c130b10>
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_5e98bcfbac81df15d9e6df90bf7267d2.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5e98bcfbac81df15d9e6df90bf7267d2.jpg saved to cache
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c31aa10>
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_77a9a70174a6437a209edca4ccdcb818.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_77a9a70174a6437a209edca4ccdcb818.jpg saved to cache
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c881901e2b8f91e5005580fdef2a1bfd.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: UP41992
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP41992%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for UP41992: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: KU98013
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU98013%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for KU98013: 0
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_e62520bffc46861514d9de4537b04a7a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_e62520bffc46861514d9de4537b04a7a.jpg not downloaded yet
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: PZ78942
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ78942%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for PZ78942: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: KA69441
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA69441%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for KA69441: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: WH21616
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH21616%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for WH21616: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: SC41958
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC41958%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for SC41958: 2
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_74c204839bd3ee77954771fa528ca994.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c3f1490>
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_5fbda15cd5ed4ff3f2a0abc28c7bc3ac.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5fbda15cd5ed4ff3f2a0abc28c7bc3ac.jpg saved to cache
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: YZ87320
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ87320%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for YZ87320: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: ZV43271
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV43271%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for ZV43271: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: DH75508
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH75508%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for DH75508: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: TG43398
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG43398%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for TG43398: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: UC75679
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC75679%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for UC75679: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: XB63829
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB63829%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for XB63829: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: MU76690
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU76690%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for MU76690: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: FC73601
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC73601%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for FC73601: 0
2026-01-29 06:01:47 [auto1.es] INFO: Found listing with ID: RN25115
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN25115%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.es] INFO: Scrape type for RN25115: 2
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9e566256745b39f792df342414d46f46.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0655d34750>
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_c881901e2b8f91e5005580fdef2a1bfd.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c881901e2b8f91e5005580fdef2a1bfd.jpg saved to cache
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c66e5c9cc094c6bb2320033e2d96512c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: DS26733
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS26733%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for DS26733: 0
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: FT06855
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT06855%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for FT06855: 0
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: CN26718
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN26718%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for CN26718: 0
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: FX59239
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX59239%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for FX59239: 0
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: SH07171
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH07171%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for SH07171: 0
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: BY66605
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY66605%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for BY66605: 2
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f06577f6ed0>
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_74c204839bd3ee77954771fa528ca994.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_74c204839bd3ee77954771fa528ca994.jpg saved to cache
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:48 [auto1.es] INFO: Found listing with ID: TF16142
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF16142%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.es] INFO: Scrape type for TF16142: 2
2026-01-29 06:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV32850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c324310>
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_9e566256745b39f792df342414d46f46.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9e566256745b39f792df342414d46f46.jpg saved to cache
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_e62520bffc46861514d9de4537b04a7a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f06577dc210>
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_c66e5c9cc094c6bb2320033e2d96512c.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c66e5c9cc094c6bb2320033e2d96512c.jpg saved to cache
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: BZ30426
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30426%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for BZ30426: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: PE50169
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE50169%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for PE50169: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: VV48202
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48202%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for VV48202: 2
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: NS33464
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS33464%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for NS33464: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: HS37774
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS37774%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for HS37774: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: MY29147
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY29147%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for MY29147: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: AH87062
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH87062%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for AH87062: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: GM59707
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM59707%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for GM59707: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: DC86019
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC86019%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for DC86019: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: BK93100
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK93100%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for BK93100: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: YE75668
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE75668%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for YE75668: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: LL47969
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL47969%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for LL47969: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: YK05158
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK05158%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for YK05158: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: BB75805
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB75805%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for BB75805: 0
2026-01-29 06:01:49 [auto1.es] INFO: Found listing with ID: JE81158
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE81158%27 HTTP/1.1" 200 None
2026-01-29 06:01:49 [auto1.es] INFO: Scrape type for JE81158: 0
2026-01-29 06:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF40460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX39170> (referer: https://www.auto1.com/v1/car-details-view/PX39170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f065c31aad0>
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F38%252F42388764e3c16a03b81233333bfef8fd%252Fpa%252FHU77878_e62520bffc46861514d9de4537b04a7a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_e62520bffc46861514d9de4537b04a7a.jpg saved to cache
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5c99c34e-658d-5c66-9d25-05565af34e50
2026-01-29 06:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c99c34e-658d-5c66-9d25-05565af34e50, skipping ID generation
2026-01-29 06:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c99c34e-658d-5c66-9d25-05565af34e50 with scrape type 1
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5c99c34e-658d-5c66-9d25-05565af34e50 from tracking dictionaries
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c99c34e-658d-5c66-9d25-05565af34e50 sending to next pipeline
2026-01-29 06:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c99c34e-658d-5c66-9d25-05565af34e50, identifier: HU77878
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR90298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS02868/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ42428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE91492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c99c34e-658d-5c66-9d25-05565af34e50 with identifier: HU77878
2026-01-29 06:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c99c34e-658d-5c66-9d25-05565af34e50 with identifier: HU77878
2026-01-29 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162960 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162960
2026-01-29 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5c99c34e-658d-5c66-9d25-05565af34e50 spider: auto1.es
2026-01-29 06:01:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5c99c34e-658d-5c66-9d25-05565af34e50 due to rule: high_mileage_for_country.json, error: 162960 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162960
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:58:39Z',
'fuel_type': 'diesel',
'id': '5c99c34e-658d-5c66-9d25-05565af34e50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU77878',
'listing': 'auction',
'location': 'ES, Palma de Mallorca',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 162960,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_0ebae0f79cc592087b8e89e37b143df9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_1d0e6b44d4ec7030f22edea5767bed39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_01e9e0a1d7060b8037d4d0986c9fe5c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_b90f329777dbe28b6f905c4024368218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_98b3d1a0cc5ab8e24484ef779a9c752a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9db00f5227265344138f448f28cd173b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_57176fde251cba0261d7047a7dc19a36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_eb7ec9f4415386d8c7ab226cf4583e56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5e98bcfbac81df15d9e6df90bf7267d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_77a9a70174a6437a209edca4ccdcb818.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_5fbda15cd5ed4ff3f2a0abc28c7bc3ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c881901e2b8f91e5005580fdef2a1bfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_74c204839bd3ee77954771fa528ca994.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_9e566256745b39f792df342414d46f46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_c66e5c9cc094c6bb2320033e2d96512c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c99c34e-658d-5c66-9d25-05565af34e50/5c99c34e-658d-5c66-9d25-05565af34e50_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/38/42388764e3c16a03b81233333bfef8fd/pa/HU77878_e62520bffc46861514d9de4537b04a7a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-11',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2017}
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU77878%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Saving data for HU77878: {'created_time': 1769666510.186151, 'last_price_update_time': 1769666510.186161, 'auction_closing_time': 1769705919.0}
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HU77878') HTTP/1.1" 204 0
2026-01-29 06:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:50 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:50 [auto1.es] INFO: Found listing with ID: XR10719
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR10719%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Scrape type for XR10719: 0
2026-01-29 06:01:50 [auto1.es] INFO: Found listing with ID: WU22909
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU22909%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Scrape type for WU22909: 0
2026-01-29 06:01:50 [auto1.es] INFO: Found listing with ID: CP16982
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Scrape type for CP16982: 0
2026-01-29 06:01:50 [auto1.es] INFO: Found listing with ID: AW48734
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW48734%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Scrape type for AW48734: 0
2026-01-29 06:01:50 [auto1.es] INFO: Found listing with ID: DH46194
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH46194%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Scrape type for DH46194: 0
2026-01-29 06:01:50 [auto1.es] INFO: Found listing with ID: KP13931
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP13931%27 HTTP/1.1" 200 None
2026-01-29 06:01:50 [auto1.es] INFO: Scrape type for KP13931: 2
2026-01-29 06:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cdadb56-4a80-54d3-b7d4-52e02601b6c0 with identifier: PX39170
2026-01-29 06:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cdadb56-4a80-54d3-b7d4-52e02601b6c0 with scrape type 2
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cdadb56-4a80-54d3-b7d4-52e02601b6c0 with scrape type 2
2026-01-29 06:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cdadb56-4a80-54d3-b7d4-52e02601b6c0, identifier: PX39170
2026-01-29 06:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cdadb56-4a80-54d3-b7d4-52e02601b6c0 with identifier: PX39170
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-29 06:01:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cdadb56-4a80-54d3-b7d4-52e02601b6c0 with identifier: PX39170
2026-01-29 06:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7cdadb56-4a80-54d3-b7d4-52e02601b6c0 with identifier: PX39170 to the API
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX39170>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:01:08Z',
'fuel_type': 'petrol',
'id': '7cdadb56-4a80-54d3-b7d4-52e02601b6c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX39170',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Hyundai',
'model': 'i20',
'odometer': 35364,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i20 1.0 TGDI Klass',
'transmission': 'manual',
'trim': 'Klass',
'year': 2024}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX39170%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Saving data for PX39170: {'auction_closing_time': 1769702468.0, 'created_time': 1765346593.816568, 'last_price_update_time': 1769666511.227563}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX39170') HTTP/1.1" 204 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: WK51588
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK51588%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for WK51588: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: KM22208
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM22208%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for KM22208: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: BK91545
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK91545%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for BK91545: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: HT92350
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT92350%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for HT92350: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: SL57759
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL57759%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for SL57759: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: PA80546
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA80546%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for PA80546: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: XZ38594
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ38594%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for XZ38594: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: MK17684
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK17684%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for MK17684: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: XR27466
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR27466%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for XR27466: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: LL06735
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL06735%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for LL06735: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: CG01889
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG01889%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for CG01889: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: SG66312
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG66312%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for SG66312: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: SA43720
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA43720%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for SA43720: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: SB80679
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB80679%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for SB80679: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: SG18347
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG18347%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for SG18347: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: DF95079
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95079%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for DF95079: 2
2026-01-29 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF24030> (referer: https://www.auto1.com/v1/car-details-view/JF24030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: AT07824
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT07824%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for AT07824: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: AR93411
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR93411%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for AR93411: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: YG04204
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG04204%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for YG04204: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: WV71911
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV71911%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for WV71911: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: VM33261
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM33261%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for VM33261: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: KE41233
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE41233%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for KE41233: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: EF24544
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF24544%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for EF24544: 2
2026-01-29 06:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: TV27917
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV27917%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for TV27917: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: XY39863
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY39863%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for XY39863: 2
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: EW64430
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW64430%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for EW64430: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: AJ93542
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ93542%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for AJ93542: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: JA12453
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA12453%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for JA12453: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: VR72202
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR72202%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for VR72202: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: HZ35846
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ35846%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for HZ35846: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: HK66520
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK66520%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for HK66520: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: DG23873
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG23873%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for DG23873: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: WK75325
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK75325%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.es] INFO: Scrape type for WK75325: 0
2026-01-29 06:01:51 [auto1.es] INFO: Found listing with ID: TV84112
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV84112%27 HTTP/1.1" 200 None
2026-01-29 06:01:52 [auto1.es] INFO: Scrape type for TV84112: 0
2026-01-29 06:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d794ab19-cbc5-5505-ae8b-eecc83630fbc with identifier: JF24030
2026-01-29 06:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d794ab19-cbc5-5505-ae8b-eecc83630fbc with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d794ab19-cbc5-5505-ae8b-eecc83630fbc with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d794ab19-cbc5-5505-ae8b-eecc83630fbc, identifier: JF24030
2026-01-29 06:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d794ab19-cbc5-5505-ae8b-eecc83630fbc with identifier: JF24030
2026-01-29 06:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d794ab19-cbc5-5505-ae8b-eecc83630fbc with identifier: JF24030
2026-01-29 06:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d794ab19-cbc5-5505-ae8b-eecc83630fbc with identifier: JF24030 to the API
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF24030>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:25:47Z',
'fuel_type': 'petrol',
'id': 'd794ab19-cbc5-5505-ae8b-eecc83630fbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF24030',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 55521,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2021}
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF24030%27 HTTP/1.1" 200 None
2026-01-29 06:01:52 [auto1.es] INFO: Saving data for JF24030: {'auction_closing_time': 1769703947.0, 'created_time': 1768324231.034279, 'last_price_update_time': 1769666512.427167}
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JF24030') HTTP/1.1" 204 0
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC41958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN25115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR58264> (referer: https://www.auto1.com/v1/car-details-view/ZR58264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU57331> (referer: https://www.auto1.com/v1/car-details-view/XU57331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF42386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE29984> (referer: https://www.auto1.com/v1/car-details-view/PE29984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264
2026-01-29 06:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ed744c-e5ed-5244-a243-e965a24ef828 with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ed744c-e5ed-5244-a243-e965a24ef828 with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7ed744c-e5ed-5244-a243-e965a24ef828, identifier: ZR58264
2026-01-29 06:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264
2026-01-29 06:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264
2026-01-29 06:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264 to the API
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZR58264>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:25:09Z',
'fuel_type': 'petrol',
'id': 'e7ed744c-e5ed-5244-a243-e965a24ef828',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR58264',
'listing': 'auction',
'location': 'ES, Granollers',
'make': 'Seat',
'model': 'Leon',
'odometer': 59686,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.5 eTSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2020}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-01-29 06:01:53 [auto1.es] INFO: Saving data for ZR58264: {'auction_closing_time': 1769703909.0, 'created_time': 1769533392.860739, 'last_price_update_time': 1769666513.052965}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR58264') HTTP/1.1" 204 0
2026-01-29 06:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY66605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3df4e03a-dc34-505a-bde0-295e4098b9c5 with identifier: XU57331
2026-01-29 06:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3df4e03a-dc34-505a-bde0-295e4098b9c5 with scrape type 2
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3df4e03a-dc34-505a-bde0-295e4098b9c5 with scrape type 2
2026-01-29 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3df4e03a-dc34-505a-bde0-295e4098b9c5, identifier: XU57331
2026-01-29 06:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a385478-5315-53d8-abc6-7bd0cbc70ab3 with identifier: PE29984
2026-01-29 06:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a385478-5315-53d8-abc6-7bd0cbc70ab3 with scrape type 2
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a385478-5315-53d8-abc6-7bd0cbc70ab3 with scrape type 2
2026-01-29 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a385478-5315-53d8-abc6-7bd0cbc70ab3, identifier: PE29984
2026-01-29 06:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3df4e03a-dc34-505a-bde0-295e4098b9c5 with identifier: XU57331
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3df4e03a-dc34-505a-bde0-295e4098b9c5 with identifier: XU57331
2026-01-29 06:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3df4e03a-dc34-505a-bde0-295e4098b9c5 with identifier: XU57331 to the API
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XU57331>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2026-01-29T16:25:10Z',
'fuel_type': 'petrol',
'id': '3df4e03a-dc34-505a-bde0-295e4098b9c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU57331',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 12644,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2024}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU57331%27 HTTP/1.1" 200 None
2026-01-29 06:01:53 [auto1.es] INFO: Saving data for XU57331: {'auction_closing_time': 1769703910.0, 'created_time': 1768410362.134999, 'last_price_update_time': 1769666513.584049}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XU57331') HTTP/1.1" 204 0
2026-01-29 06:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a385478-5315-53d8-abc6-7bd0cbc70ab3 with identifier: PE29984
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a385478-5315-53d8-abc6-7bd0cbc70ab3 with identifier: PE29984
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1a385478-5315-53d8-abc6-7bd0cbc70ab3 spider: auto1.es
2026-01-29 06:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1a385478-5315-53d8-abc6-7bd0cbc70ab3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 99,
'expiration_date': '2026-01-29T16:06:23Z',
'fuel_type': 'diesel',
'id': '1a385478-5315-53d8-abc6-7bd0cbc70ab3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE29984',
'listing': 'auction',
'location': 'ES, Granyanella',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 195254,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Aniversario Edition',
'transmission': 'manual',
'trim': '20 Aniversario Edition',
'year': 2017}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE29984%27 HTTP/1.1" 200 None
2026-01-29 06:01:53 [auto1.es] INFO: Saving data for PE29984: {'auction_closing_time': 1769702783.0, 'created_time': 1769580039.236495, 'last_price_update_time': 1769666513.832143}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE29984') HTTP/1.1" 204 0
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG36099> (referer: https://www.auto1.com/v1/car-details-view/KG36099/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d3deccf-8dc6-5b00-b720-f152c443d509 with identifier: KG36099
2026-01-29 06:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d3deccf-8dc6-5b00-b720-f152c443d509 with scrape type 2
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d3deccf-8dc6-5b00-b720-f152c443d509 with scrape type 2
2026-01-29 06:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d3deccf-8dc6-5b00-b720-f152c443d509, identifier: KG36099
2026-01-29 06:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d3deccf-8dc6-5b00-b720-f152c443d509 with identifier: KG36099
2026-01-29 06:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d3deccf-8dc6-5b00-b720-f152c443d509 with identifier: KG36099
2026-01-29 06:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d3deccf-8dc6-5b00-b720-f152c443d509 with identifier: KG36099 to the API
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG36099>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2026-01-29T16:35:28Z',
'fuel_type': 'petrol',
'id': '2d3deccf-8dc6-5b00-b720-f152c443d509',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG36099',
'listing': 'auction',
'location': 'ES, Atarfe, Granada',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 41945,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG36099%27 HTTP/1.1" 200 None
2026-01-29 06:01:54 [auto1.es] INFO: Saving data for KG36099: {'auction_closing_time': 1769704528.0, 'created_time': 1769447494.038289, 'last_price_update_time': 1769666514.561374}
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KG36099') HTTP/1.1" 204 0
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS02868> (referer: https://www.auto1.com/v1/car-details-view/PS02868/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF16142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE91492> (referer: https://www.auto1.com/v1/car-details-view/JE91492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV48202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3089932f-f83d-5d8f-bfbd-31558846c09f with identifier: PS02868
2026-01-29 06:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3089932f-f83d-5d8f-bfbd-31558846c09f with scrape type 2
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3089932f-f83d-5d8f-bfbd-31558846c09f with scrape type 2
2026-01-29 06:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3089932f-f83d-5d8f-bfbd-31558846c09f, identifier: PS02868
2026-01-29 06:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3089932f-f83d-5d8f-bfbd-31558846c09f with identifier: PS02868
2026-01-29 06:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3089932f-f83d-5d8f-bfbd-31558846c09f with identifier: PS02868
2026-01-29 06:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3089932f-f83d-5d8f-bfbd-31558846c09f spider: auto1.es
2026-01-29 06:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3089932f-f83d-5d8f-bfbd-31558846c09f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:28:30Z',
'fuel_type': 'diesel',
'id': '3089932f-f83d-5d8f-bfbd-31558846c09f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS02868',
'listing': 'auction',
'location': 'ES, Mataró',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 57176,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-16',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Feel Pack M',
'transmission': 'manual',
'trim': 'Feel Pack M',
'year': 2021}
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS02868%27 HTTP/1.1" 200 None
2026-01-29 06:01:54 [auto1.es] INFO: Saving data for PS02868: {'auction_closing_time': 1769704110.0, 'created_time': 1768582884.011723, 'last_price_update_time': 1769666514.996712}
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS02868') HTTP/1.1" 204 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: VG86564
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG86564%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for VG86564: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: DM65680
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM65680%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for DM65680: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: NB95025
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB95025%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for NB95025: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: KY51908
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY51908%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for KY51908: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: NZ05021
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ05021%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for NZ05021: 2
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV32850> (referer: https://www.auto1.com/v1/car-details-view/NV32850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: BU18758
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU18758%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for BU18758: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: RG84435
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG84435%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for RG84435: 2
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17884d69-f60f-56a9-b486-c269b0fe1caf with identifier: JE91492
2026-01-29 06:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17884d69-f60f-56a9-b486-c269b0fe1caf with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17884d69-f60f-56a9-b486-c269b0fe1caf with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17884d69-f60f-56a9-b486-c269b0fe1caf, identifier: JE91492
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: ZW53743
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW53743%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for ZW53743: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: SD03566
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD03566%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for SD03566: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: EF10365
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF10365%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for EF10365: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: ZN33203
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN33203%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for ZN33203: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: YW79111
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW79111%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for YW79111: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: CC08164
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC08164%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for CC08164: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: FN28666
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN28666%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for FN28666: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: EB01783
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB01783%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for EB01783: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: MU67506
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU67506%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for MU67506: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: DS42714
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS42714%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for DS42714: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: RN59031
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59031%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for RN59031: 0
2026-01-29 06:01:55 [auto1.es] INFO: Found listing with ID: PX23975
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX23975%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.es] INFO: Scrape type for PX23975: 2
2026-01-29 06:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17884d69-f60f-56a9-b486-c269b0fe1caf with identifier: JE91492
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17884d69-f60f-56a9-b486-c269b0fe1caf with identifier: JE91492
2026-01-29 06:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 17884d69-f60f-56a9-b486-c269b0fe1caf with identifier: JE91492 to the API
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE91492>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:46:04Z',
'fuel_type': 'petrol',
'id': '17884d69-f60f-56a9-b486-c269b0fe1caf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE91492',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Seat',
'model': 'Leon',
'odometer': 87137,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.5 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2019}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE91492%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Saving data for JE91492: {'auction_closing_time': 1769705164.0, 'created_time': 1767780173.490985, 'last_price_update_time': 1769666516.203775}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JE91492') HTTP/1.1" 204 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: FG34544
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG34544%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for FG34544: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: BN00147
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN00147%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for BN00147: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: XT61158
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT61158%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for XT61158: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: XS28842
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS28842%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for XS28842: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: GN29508
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN29508%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for GN29508: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: ZG02337
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG02337%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for ZG02337: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: SH61762
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH61762%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for SH61762: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: RG88899
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG88899%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for RG88899: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: EF96991
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF96991%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for EF96991: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: ST27973
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST27973%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for ST27973: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: ZN88133
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN88133%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for ZN88133: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: US72477
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US72477%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for US72477: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: MS00021
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS00021%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for MS00021: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: VX43785
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX43785%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for VX43785: 2
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF95079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1953e0fb-eb4e-535e-83fc-266932f2db43 with identifier: NV32850
2026-01-29 06:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1953e0fb-eb4e-535e-83fc-266932f2db43 with scrape type 2
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1953e0fb-eb4e-535e-83fc-266932f2db43 with scrape type 2
2026-01-29 06:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1953e0fb-eb4e-535e-83fc-266932f2db43, identifier: NV32850
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: MA69462
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA69462%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for MA69462: 0
2026-01-29 06:01:56 [auto1.es] INFO: Found listing with ID: YR71719
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.es] INFO: Scrape type for YR71719: 2
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1953e0fb-eb4e-535e-83fc-266932f2db43 with identifier: NV32850
2026-01-29 06:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1953e0fb-eb4e-535e-83fc-266932f2db43 with identifier: NV32850
2026-01-29 06:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1953e0fb-eb4e-535e-83fc-266932f2db43 with identifier: NV32850 to the API
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV32850>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-01-29T16:42:38Z',
'fuel_type': 'diesel',
'id': '1953e0fb-eb4e-535e-83fc-266932f2db43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV32850',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Peugeot',
'model': '308',
'odometer': 127141,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV32850%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Saving data for NV32850: {'auction_closing_time': 1769704958.0, 'created_time': 1768217710.107243, 'last_price_update_time': 1769666517.045465}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NV32850') HTTP/1.1" 204 0
2026-01-29 06:01:57 [auto1.es] INFO: Found listing with ID: XE14806
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE14806%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Scrape type for XE14806: 0
2026-01-29 06:01:57 [auto1.es] INFO: Found listing with ID: XM73958
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM73958%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Scrape type for XM73958: 0
2026-01-29 06:01:57 [auto1.es] INFO: Found listing with ID: WG12955
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12955%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Scrape type for WG12955: 0
2026-01-29 06:01:57 [auto1.es] INFO: Found listing with ID: KL05378
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL05378%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Scrape type for KL05378: 2
2026-01-29 06:01:57 [auto1.es] INFO: Found listing with ID: RH90347
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH90347%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Scrape type for RH90347: 0
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF24544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP13931/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF40460> (referer: https://www.auto1.com/v1/car-details-view/GF40460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR90298> (referer: https://www.auto1.com/v1/car-details-view/CR90298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY39863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460
2026-01-29 06:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef322325-6fd3-593c-bf49-ce981b5c07cd with scrape type 2
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef322325-6fd3-593c-bf49-ce981b5c07cd with scrape type 2
2026-01-29 06:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef322325-6fd3-593c-bf49-ce981b5c07cd, identifier: GF40460
2026-01-29 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460
2026-01-29 06:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460 to the API
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF40460>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 204,
'expiration_date': '2026-01-29T16:20:15Z',
'fuel_type': 'petrol',
'id': 'ef322325-6fd3-593c-bf49-ce981b5c07cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF40460',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Kia',
'model': 'XCeed',
'odometer': 48670,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Kia XCeed 1.6 TGDI Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2021}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF40460%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.es] INFO: Saving data for GF40460: {'auction_closing_time': 1769703615.0, 'created_time': 1768912710.598014, 'last_price_update_time': 1769666517.864689}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF40460') HTTP/1.1" 204 0
2026-01-29 06:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e with identifier: CR90298
2026-01-29 06:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e with scrape type 2
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e with scrape type 2
2026-01-29 06:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e, identifier: CR90298
2026-01-29 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e with identifier: CR90298
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e with identifier: CR90298
2026-01-29 06:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d1d2e59-58a8-5c2a-9a6f-83bd889e990e with identifier: CR90298 to the API
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR90298>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:41:03Z',
'fuel_type': 'hybrid',
'id': '6d1d2e59-58a8-5c2a-9a6f-83bd889e990e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR90298',
'listing': 'auction',
'location': 'ES, Alcalá de Henares',
'make': 'Ford',
'model': 'Kuga',
'odometer': 30988,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2023}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR90298%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.es] INFO: Saving data for CR90298: {'auction_closing_time': 1769704863.0, 'created_time': 1768824435.281245, 'last_price_update_time': 1769666518.290776}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CR90298') HTTP/1.1" 204 0
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC41958> (referer: https://www.auto1.com/v1/car-details-view/SC41958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5874892-a3c4-5aa6-af6a-0b95a217aa7d with identifier: SC41958
2026-01-29 06:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5874892-a3c4-5aa6-af6a-0b95a217aa7d with scrape type 2
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5874892-a3c4-5aa6-af6a-0b95a217aa7d with scrape type 2
2026-01-29 06:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d5874892-a3c4-5aa6-af6a-0b95a217aa7d, identifier: SC41958
2026-01-29 06:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d5874892-a3c4-5aa6-af6a-0b95a217aa7d with identifier: SC41958
2026-01-29 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d5874892-a3c4-5aa6-af6a-0b95a217aa7d with identifier: SC41958
2026-01-29 06:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d5874892-a3c4-5aa6-af6a-0b95a217aa7d with identifier: SC41958 to the API
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC41958>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:09:29Z',
'fuel_type': 'diesel',
'id': 'd5874892-a3c4-5aa6-af6a-0b95a217aa7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC41958',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Jeep',
'model': 'Compass',
'odometer': 63181,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2020}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC41958%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.es] INFO: Saving data for SC41958: {'auction_closing_time': 1769702969.0, 'created_time': 1769533337.53927, 'last_price_update_time': 1769666518.894973}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SC41958') HTTP/1.1" 204 0
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF42386> (referer: https://www.auto1.com/v1/car-details-view/PF42386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN25115> (referer: https://www.auto1.com/v1/car-details-view/RN25115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY66605> (referer: https://www.auto1.com/v1/car-details-view/BY66605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5238b6fb-045c-5988-9a75-4eff63994ab0 with identifier: PF42386
2026-01-29 06:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5238b6fb-045c-5988-9a75-4eff63994ab0 with scrape type 2
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5238b6fb-045c-5988-9a75-4eff63994ab0 with scrape type 2
2026-01-29 06:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5238b6fb-045c-5988-9a75-4eff63994ab0, identifier: PF42386
2026-01-29 06:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5238b6fb-045c-5988-9a75-4eff63994ab0 with identifier: PF42386
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5238b6fb-045c-5988-9a75-4eff63994ab0 with identifier: PF42386
2026-01-29 06:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5238b6fb-045c-5988-9a75-4eff63994ab0 with identifier: PF42386 to the API
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF42386>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:30:26Z',
'fuel_type': 'diesel',
'id': '5238b6fb-045c-5988-9a75-4eff63994ab0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF42386',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Audi',
'model': 'Q2',
'odometer': 146135,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-19',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.6 TDI Design edition',
'transmission': 'manual',
'trim': 'Design edition',
'year': 2018}
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF42386%27 HTTP/1.1" 200 None
2026-01-29 06:01:59 [auto1.es] INFO: Saving data for PF42386: {'auction_closing_time': 1769704226.0, 'created_time': 1769447045.349331, 'last_price_update_time': 1769666519.765489}
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PF42386') HTTP/1.1" 204 0
2026-01-29 06:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c354159-8e13-5512-a33b-86544ab53649 with identifier: RN25115
2026-01-29 06:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c354159-8e13-5512-a33b-86544ab53649 with scrape type 2
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c354159-8e13-5512-a33b-86544ab53649 with scrape type 2
2026-01-29 06:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c354159-8e13-5512-a33b-86544ab53649, identifier: RN25115
2026-01-29 06:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d with identifier: BY66605
2026-01-29 06:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d with scrape type 2
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d with scrape type 2
2026-01-29 06:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d, identifier: BY66605
2026-01-29 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF16142> (referer: https://www.auto1.com/v1/car-details-view/TF16142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c354159-8e13-5512-a33b-86544ab53649 with identifier: RN25115
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c354159-8e13-5512-a33b-86544ab53649 with identifier: RN25115
2026-01-29 06:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c354159-8e13-5512-a33b-86544ab53649 with identifier: RN25115 to the API
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN25115>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-29T16:19:33Z',
'fuel_type': 'petrol',
'id': '0c354159-8e13-5512-a33b-86544ab53649',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN25115',
'listing': 'auction',
'location': 'ES, Aldaya',
'make': 'Ford',
'model': 'Puma',
'odometer': 48260,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X Design',
'transmission': 'manual',
'trim': 'ST-Line X Design',
'year': 2023}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN25115%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.es] INFO: Saving data for RN25115: {'auction_closing_time': 1769703573.0, 'created_time': 1768824791.260767, 'last_price_update_time': 1769666520.35096}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN25115') HTTP/1.1" 204 0
2026-01-29 06:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d with identifier: BY66605
2026-01-29 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d with identifier: BY66605
2026-01-29 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 97162, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/by66605', 'expiration_date': '2026-01-29t16:54:16z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 97162}
Failed validating None in schema:
False
On instance:
{'age_in_months': 100,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2026-01-29t16:54:16z',
'fuel_type': 'petrol',
'id': '092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/by66605',
'listing': 'auction',
'location': 'es, araia',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 97162,
'odometer_in_km': 97162,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
2026-01-29 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d spider: auto1.es
2026-01-29 06:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 97162, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/by66605', 'expiration_date': '2026-01-29t16:54:16z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 97162}
Failed validating None in schema:
False
On instance:
{'age_in_months': 100,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2026-01-29t16:54:16z',
'fuel_type': 'petrol',
'id': '092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/by66605',
'listing': 'auction',
'location': 'es, araia',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 97162,
'odometer_in_km': 97162,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:54:16Z',
'fuel_type': 'petrol',
'id': '092c7cc0-f86f-52ef-9d1a-8cdf7b6f465d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY66605',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Peugeot',
'model': '2008',
'odometer': 97162,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY66605%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.es] INFO: Saving data for BY66605: {'auction_closing_time': 1769705656.0, 'created_time': 1768928552.805081, 'last_price_update_time': 1769666520.572024}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BY66605') HTTP/1.1" 204 0
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ05021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ42428> (referer: https://www.auto1.com/v1/car-details-view/SZ42428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [auto1.es] INFO: Found listing with ID: GD31300
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD31300%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.es] INFO: Scrape type for GD31300: 0
2026-01-29 06:02:00 [auto1.es] INFO: Found listing with ID: VV48377
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48377%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.es] INFO: Scrape type for VV48377: 2
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51db9e7b-5517-5722-bc0c-d5d023c25ab4 with identifier: TF16142
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51db9e7b-5517-5722-bc0c-d5d023c25ab4 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51db9e7b-5517-5722-bc0c-d5d023c25ab4 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51db9e7b-5517-5722-bc0c-d5d023c25ab4, identifier: TF16142
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG84435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51db9e7b-5517-5722-bc0c-d5d023c25ab4 with identifier: TF16142
2026-01-29 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51db9e7b-5517-5722-bc0c-d5d023c25ab4 with identifier: TF16142
2026-01-29 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176159 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
176159
2026-01-29 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 51db9e7b-5517-5722-bc0c-d5d023c25ab4 spider: auto1.es
2026-01-29 06:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 51db9e7b-5517-5722-bc0c-d5d023c25ab4 due to rule: high_mileage_for_country.json, error: 176159 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
176159
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 245,
'expiration_date': '2026-01-29T16:07:00Z',
'fuel_type': 'petrol',
'id': '51db9e7b-5517-5722-bc0c-d5d023c25ab4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF16142',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 176159,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-10',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF16142%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.es] INFO: Saving data for TF16142: {'auction_closing_time': 1769702820.0, 'created_time': 1768912696.872926, 'last_price_update_time': 1769666520.969184}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF16142') HTTP/1.1" 204 0
2026-01-29 06:02:00 [auto1.es] INFO: Found listing with ID: HN40641
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN40641%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for HN40641: 2
2026-01-29 06:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a98b578b-9bb1-5eac-b0f5-b4de4597f56a with identifier: SZ42428
2026-01-29 06:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a98b578b-9bb1-5eac-b0f5-b4de4597f56a with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a98b578b-9bb1-5eac-b0f5-b4de4597f56a with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a98b578b-9bb1-5eac-b0f5-b4de4597f56a, identifier: SZ42428
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: SA36026
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA36026%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for SA36026: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: XU22328
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU22328%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for XU22328: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: YD01288
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD01288%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for YD01288: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: SP20067
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP20067%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for SP20067: 2
2026-01-29 06:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a98b578b-9bb1-5eac-b0f5-b4de4597f56a with identifier: SZ42428
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a98b578b-9bb1-5eac-b0f5-b4de4597f56a with identifier: SZ42428
2026-01-29 06:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a98b578b-9bb1-5eac-b0f5-b4de4597f56a with identifier: SZ42428 to the API
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SZ42428>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-01-29T16:41:34Z',
'fuel_type': 'petrol',
'id': 'a98b578b-9bb1-5eac-b0f5-b4de4597f56a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ42428',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Fiat',
'model': '500',
'odometer': 53693,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-30',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2020}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ42428%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Saving data for SZ42428: {'auction_closing_time': 1769704894.0, 'created_time': 1768237899.848567, 'last_price_update_time': 1769666521.502322}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SZ42428') HTTP/1.1" 204 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: VJ79904
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ79904%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for VJ79904: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: SA80278
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA80278%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for SA80278: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: FD79630
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD79630%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for FD79630: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: AJ32908
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ32908%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for AJ32908: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: RZ41545
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ41545%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for RZ41545: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: UJ63738
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ63738%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for UJ63738: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: GU92487
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU92487%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for GU92487: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: CV22781
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV22781%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for CV22781: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: TB61006
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB61006%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for TB61006: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: NZ48494
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ48494%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for NZ48494: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: CF97208
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF97208%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for CF97208: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: FH99836
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH99836%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for FH99836: 2
2026-01-29 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL05378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV48202> (referer: https://www.auto1.com/v1/car-details-view/VV48202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX43785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF95079> (referer: https://www.auto1.com/v1/car-details-view/DF95079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: JA64346
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA64346%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for JA64346: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: AR73253
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR73253%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for AR73253: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: GR77788
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR77788%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for GR77788: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: DS37316
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS37316%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for DS37316: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: WJ42135
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ42135%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for WJ42135: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: KW77045
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW77045%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for KW77045: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: NY35740
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35740%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for NY35740: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: ZC41247
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC41247%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for ZC41247: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: DJ65023
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ65023%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for DJ65023: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: TV18769
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV18769%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.es] INFO: Scrape type for TV18769: 0
2026-01-29 06:02:01 [auto1.es] INFO: Found listing with ID: BX04105
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX04105%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for BX04105: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: ZR62328
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR62328%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for ZR62328: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: DU80277
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU80277%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for DU80277: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: ZJ66849
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ66849%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for ZJ66849: 2
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: UN49290
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN49290%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for UN49290: 2
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: LW77816
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW77816%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for LW77816: 2
2026-01-29 06:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ddc6bc-4b62-5853-b06e-66fb5babce49 with identifier: VV48202
2026-01-29 06:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ddc6bc-4b62-5853-b06e-66fb5babce49 with scrape type 2
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ddc6bc-4b62-5853-b06e-66fb5babce49 with scrape type 2
2026-01-29 06:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6ddc6bc-4b62-5853-b06e-66fb5babce49, identifier: VV48202
2026-01-29 06:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280fd87e-b75f-565f-8863-6c9d2342ebe4 with identifier: DF95079
2026-01-29 06:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280fd87e-b75f-565f-8863-6c9d2342ebe4 with scrape type 2
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 280fd87e-b75f-565f-8863-6c9d2342ebe4 with scrape type 2
2026-01-29 06:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 280fd87e-b75f-565f-8863-6c9d2342ebe4, identifier: DF95079
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: KY97566
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY97566%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for KY97566: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: BM19053
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM19053%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for BM19053: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: BX26344
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX26344%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for BX26344: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: JU32619
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU32619%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for JU32619: 0
2026-01-29 06:02:02 [auto1.es] INFO: Found listing with ID: ML12744
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML12744%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Scrape type for ML12744: 0
2026-01-29 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6ddc6bc-4b62-5853-b06e-66fb5babce49 with identifier: VV48202
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6ddc6bc-4b62-5853-b06e-66fb5babce49 with identifier: VV48202
2026-01-29 06:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6ddc6bc-4b62-5853-b06e-66fb5babce49 with identifier: VV48202 to the API
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV48202>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:29:18Z',
'fuel_type': 'diesel',
'id': 'e6ddc6bc-4b62-5853-b06e-66fb5babce49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV48202',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Ford',
'model': 'Puma',
'odometer': 135797,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.5 TDCi EcoBlue Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2020}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48202%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.es] INFO: Saving data for VV48202: {'auction_closing_time': 1769704158.0, 'created_time': 1769421754.273583, 'last_price_update_time': 1769666522.729829}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV48202') HTTP/1.1" 204 0
2026-01-29 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 280fd87e-b75f-565f-8863-6c9d2342ebe4 with identifier: DF95079
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 280fd87e-b75f-565f-8863-6c9d2342ebe4 with identifier: DF95079
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'manual', 'odometer': 42061, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95079', 'expiration_date': '2026-01-29t16:12:33z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, león', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '280fd87e-b75f-565f-8863-6c9d2342ebe4', 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 42061}
Failed validating None in schema:
False
On instance:
{'age_in_months': 52,
'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'orange',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2026-01-29t16:12:33z',
'fuel_type': 'petrol',
'id': '280fd87e-b75f-565f-8863-6c9d2342ebe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95079',
'listing': 'auction',
'location': 'es, león',
'make': 'citroen',
'make_model': 'citroen c4',
'model': 'c4',
'odometer': 42061,
'odometer_in_km': 42061,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2021}
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 280fd87e-b75f-565f-8863-6c9d2342ebe4 spider: auto1.es
2026-01-29 06:02:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 280fd87e-b75f-565f-8863-6c9d2342ebe4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'manual', 'odometer': 42061, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95079', 'expiration_date': '2026-01-29t16:12:33z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, león', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '280fd87e-b75f-565f-8863-6c9d2342ebe4', 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 42061}
Failed validating None in schema:
False
On instance:
{'age_in_months': 52,
'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'orange',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2026-01-29t16:12:33z',
'fuel_type': 'petrol',
'id': '280fd87e-b75f-565f-8863-6c9d2342ebe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95079',
'listing': 'auction',
'location': 'es, león',
'make': 'citroen',
'make_model': 'citroen c4',
'model': 'c4',
'odometer': 42061,
'odometer_in_km': 42061,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:12:33Z',
'fuel_type': 'petrol',
'id': '280fd87e-b75f-565f-8863-6c9d2342ebe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF95079',
'listing': 'auction',
'location': 'ES, León',
'make': 'Citroen',
'model': 'C4',
'odometer': 42061,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2021}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95079%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [auto1.es] INFO: Saving data for DF95079: {'auction_closing_time': 1769703153.0, 'created_time': 1769446892.838362, 'last_price_update_time': 1769666523.059253}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DF95079') HTTP/1.1" 204 0
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY39863> (referer: https://www.auto1.com/v1/car-details-view/XY39863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR71719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX23975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF24544> (referer: https://www.auto1.com/v1/car-details-view/EF24544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72adc64b-0401-5d91-ba3f-47953015c319 with identifier: XY39863
2026-01-29 06:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72adc64b-0401-5d91-ba3f-47953015c319 with scrape type 2
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72adc64b-0401-5d91-ba3f-47953015c319 with scrape type 2
2026-01-29 06:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72adc64b-0401-5d91-ba3f-47953015c319, identifier: XY39863
2026-01-29 06:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72adc64b-0401-5d91-ba3f-47953015c319 with identifier: XY39863
2026-01-29 06:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72adc64b-0401-5d91-ba3f-47953015c319 with identifier: XY39863
2026-01-29 06:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72adc64b-0401-5d91-ba3f-47953015c319 with identifier: XY39863 to the API
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY39863>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 160,
'expiration_date': '2026-01-29T16:20:27Z',
'fuel_type': 'petrol',
'id': '72adc64b-0401-5d91-ba3f-47953015c319',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY39863',
'listing': 'auction',
'location': 'Cabrera de Mar',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 136509,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.0 Zenith AWD',
'transmission': 'automatic',
'trim': 'Zenith AWD',
'year': 2018}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY39863%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [auto1.es] INFO: Saving data for XY39863: {'auction_closing_time': 1769703627.0, 'created_time': 1769447138.303175, 'last_price_update_time': 1769666523.672598}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XY39863') HTTP/1.1" 204 0
2026-01-29 06:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8012b465-7494-5d85-aebc-051ab614bf45 with identifier: EF24544
2026-01-29 06:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8012b465-7494-5d85-aebc-051ab614bf45 with scrape type 2
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8012b465-7494-5d85-aebc-051ab614bf45 with scrape type 2
2026-01-29 06:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8012b465-7494-5d85-aebc-051ab614bf45, identifier: EF24544
2026-01-29 06:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8012b465-7494-5d85-aebc-051ab614bf45 with identifier: EF24544
2026-01-29 06:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8012b465-7494-5d85-aebc-051ab614bf45 with identifier: EF24544
2026-01-29 06:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8012b465-7494-5d85-aebc-051ab614bf45 with identifier: EF24544 to the API
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF24544>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-01-29T16:16:26Z',
'fuel_type': 'petrol',
'id': '8012b465-7494-5d85-aebc-051ab614bf45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF24544',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'make': 'Renault',
'model': 'Arkana',
'odometer': 96613,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.3 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2021}
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF24544%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Saving data for EF24544: {'auction_closing_time': 1769703386.0, 'created_time': 1769533320.847446, 'last_price_update_time': 1769666524.093566}
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF24544') HTTP/1.1" 204 0
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV48377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: XJ82790
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ82790%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for XJ82790: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: UL80546
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL80546%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for UL80546: 2
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: WV68266
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV68266%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for WV68266: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: FN22464
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN22464%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for FN22464: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: HL96509
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL96509%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for HL96509: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: JU30162
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU30162%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for JU30162: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: CA62039
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA62039%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for CA62039: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: HM49033
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM49033%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for HM49033: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: SU48736
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU48736%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for SU48736: 2
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP13931> (referer: https://www.auto1.com/v1/car-details-view/KP13931/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ05021> (referer: https://www.auto1.com/v1/car-details-view/NZ05021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: DD59936
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD59936%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for DD59936: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: SK17847
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK17847%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for SK17847: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: FR14993
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR14993%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for FR14993: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: KU19179
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU19179%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for KU19179: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: BG76395
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG76395%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for BG76395: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: SW19124
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW19124%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for SW19124: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: UC51375
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC51375%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for UC51375: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: PB45292
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB45292%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for PB45292: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: UU73633
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU73633%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for UU73633: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: DM42464
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM42464%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for DM42464: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: WH17991
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH17991%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for WH17991: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: YU54882
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU54882%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for YU54882: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: VE56795
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE56795%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for VE56795: 2
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: YU83589
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU83589%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for YU83589: 0
2026-01-29 06:02:04 [auto1.es] INFO: Found listing with ID: RX12180
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX12180%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.es] INFO: Scrape type for RX12180: 2
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP20067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN40641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG84435> (referer: https://www.auto1.com/v1/car-details-view/RG84435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH99836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [auto1.es] INFO: Found listing with ID: RP39282
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP39282%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [auto1.es] INFO: Scrape type for RP39282: 0
2026-01-29 06:02:05 [auto1.es] INFO: Found listing with ID: TH12996
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH12996%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [auto1.es] INFO: Scrape type for TH12996: 0
2026-01-29 06:02:05 [auto1.es] INFO: Found listing with ID: BU91578
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU91578%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [auto1.es] INFO: Scrape type for BU91578: 2
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfa0ac1d-ded4-5d73-930d-cbe02c120860 with identifier: KP13931
2026-01-29 06:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa0ac1d-ded4-5d73-930d-cbe02c120860 with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfa0ac1d-ded4-5d73-930d-cbe02c120860 with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfa0ac1d-ded4-5d73-930d-cbe02c120860, identifier: KP13931
2026-01-29 06:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4660a299-8054-5c15-aebc-c615617267fb with identifier: NZ05021
2026-01-29 06:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4660a299-8054-5c15-aebc-c615617267fb with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4660a299-8054-5c15-aebc-c615617267fb with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4660a299-8054-5c15-aebc-c615617267fb, identifier: NZ05021
2026-01-29 06:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfa0ac1d-ded4-5d73-930d-cbe02c120860 with identifier: KP13931
2026-01-29 06:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfa0ac1d-ded4-5d73-930d-cbe02c120860 with identifier: KP13931
2026-01-29 06:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dfa0ac1d-ded4-5d73-930d-cbe02c120860 with identifier: KP13931 to the API
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP13931>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:09:31Z',
'fuel_type': 'petrol',
'id': 'dfa0ac1d-ded4-5d73-930d-cbe02c120860',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP13931',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Kia',
'model': 'Stonic',
'odometer': 40099,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Drive',
'transmission': 'automatic',
'trim': 'Drive',
'year': 2021}
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP13931%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [auto1.es] INFO: Saving data for KP13931: {'auction_closing_time': 1769702971.0, 'created_time': 1769447037.496784, 'last_price_update_time': 1769666525.554736}
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP13931') HTTP/1.1" 204 0
2026-01-29 06:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4660a299-8054-5c15-aebc-c615617267fb with identifier: NZ05021
2026-01-29 06:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4660a299-8054-5c15-aebc-c615617267fb with identifier: NZ05021
2026-01-29 06:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4660a299-8054-5c15-aebc-c615617267fb with identifier: NZ05021 to the API
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ05021>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 73,
'expiration_date': '2026-01-29T16:18:54Z',
'fuel_type': 'petrol',
'id': '4660a299-8054-5c15-aebc-c615617267fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ05021',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Dacia',
'model': 'Logan',
'odometer': 21416,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Logan 1.0 SCe Essential',
'transmission': 'manual',
'trim': 'Essential',
'year': 2019}
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ05021%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Saving data for NZ05021: {'auction_closing_time': 1769703534.0, 'created_time': 1769447179.371257, 'last_price_update_time': 1769666526.01508}
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ05021') HTTP/1.1" 204 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: TD52261
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD52261%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for TD52261: 2
2026-01-29 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ66849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: GD18695
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD18695%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for GD18695: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: WA49493
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA49493%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for WA49493: 2
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe06d406-8be6-56f3-a973-f2219d0397e3 with identifier: RG84435
2026-01-29 06:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe06d406-8be6-56f3-a973-f2219d0397e3 with scrape type 2
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe06d406-8be6-56f3-a973-f2219d0397e3 with scrape type 2
2026-01-29 06:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe06d406-8be6-56f3-a973-f2219d0397e3, identifier: RG84435
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: CE60546
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE60546%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for CE60546: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: NW67921
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW67921%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for NW67921: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: UF26565
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF26565%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for UF26565: 2
2026-01-29 06:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe06d406-8be6-56f3-a973-f2219d0397e3 with identifier: RG84435
2026-01-29 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe06d406-8be6-56f3-a973-f2219d0397e3 with identifier: RG84435
2026-01-29 06:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe06d406-8be6-56f3-a973-f2219d0397e3 with identifier: RG84435 to the API
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG84435>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 163,
'expiration_date': '2026-01-29T16:40:40Z',
'fuel_type': 'petrol',
'id': 'fe06d406-8be6-56f3-a973-f2219d0397e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG84435',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 43906,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Tekna +',
'transmission': 'manual',
'trim': 'Tekna +',
'year': 2018}
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG84435%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Saving data for RG84435: {'auction_closing_time': 1769704840.0, 'created_time': 1769447306.743105, 'last_price_update_time': 1769666526.566518}
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RG84435') HTTP/1.1" 204 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: TW36856
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW36856%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for TW36856: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: AP34779
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP34779%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for AP34779: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: FC59242
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC59242%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for FC59242: 2
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: BR04177
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR04177%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for BR04177: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: MZ33552
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ33552%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for MZ33552: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: LK81480
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK81480%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for LK81480: 0
2026-01-29 06:02:06 [auto1.es] INFO: Found listing with ID: JR49367
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR49367%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.es] INFO: Scrape type for JR49367: 0
2026-01-29 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN49290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW77816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL80546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL05378> (referer: https://www.auto1.com/v1/car-details-view/KL05378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX43785> (referer: https://www.auto1.com/v1/car-details-view/VX43785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX23975> (referer: https://www.auto1.com/v1/car-details-view/PX23975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7201fc3-74a7-5530-a1a2-d3b52f9476b6 with identifier: KL05378
2026-01-29 06:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7201fc3-74a7-5530-a1a2-d3b52f9476b6 with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7201fc3-74a7-5530-a1a2-d3b52f9476b6 with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7201fc3-74a7-5530-a1a2-d3b52f9476b6, identifier: KL05378
2026-01-29 06:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 802783c4-a04a-5ad1-9afc-96959a6b56e3 with identifier: VX43785
2026-01-29 06:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 802783c4-a04a-5ad1-9afc-96959a6b56e3 with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 802783c4-a04a-5ad1-9afc-96959a6b56e3 with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 802783c4-a04a-5ad1-9afc-96959a6b56e3, identifier: VX43785
2026-01-29 06:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7201fc3-74a7-5530-a1a2-d3b52f9476b6 with identifier: KL05378
2026-01-29 06:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7201fc3-74a7-5530-a1a2-d3b52f9476b6 with identifier: KL05378
2026-01-29 06:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7201fc3-74a7-5530-a1a2-d3b52f9476b6 with identifier: KL05378 to the API
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL05378>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:45:42Z',
'fuel_type': 'petrol',
'id': 'b7201fc3-74a7-5530-a1a2-d3b52f9476b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL05378',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Seat',
'model': 'Ateca',
'odometer': 85623,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2018}
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL05378%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Saving data for KL05378: {'auction_closing_time': 1769705142.0, 'created_time': 1768912893.195305, 'last_price_update_time': 1769666528.051513}
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL05378') HTTP/1.1" 204 0
2026-01-29 06:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 802783c4-a04a-5ad1-9afc-96959a6b56e3 with identifier: VX43785
2026-01-29 06:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 802783c4-a04a-5ad1-9afc-96959a6b56e3 with identifier: VX43785
2026-01-29 06:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169986 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169986
2026-01-29 06:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 802783c4-a04a-5ad1-9afc-96959a6b56e3 spider: auto1.es
2026-01-29 06:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 802783c4-a04a-5ad1-9afc-96959a6b56e3 due to rule: high_mileage_for_country.json, error: 169986 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169986
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-01-29T16:05:02Z',
'fuel_type': 'diesel',
'id': '802783c4-a04a-5ad1-9afc-96959a6b56e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX43785',
'listing': 'auction',
'location': 'ES, El Carpio',
'make': 'Peugeot',
'model': '3008',
'odometer': 169986,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX43785%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Saving data for VX43785: {'auction_closing_time': 1769702702.0, 'created_time': 1768889536.937467, 'last_price_update_time': 1769666528.377172}
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VX43785') HTTP/1.1" 204 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: LL73819
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL73819%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for LL73819: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: MU81906
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU81906%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for MU81906: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: FK25722
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK25722%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for FK25722: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: RY07960
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY07960%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for RY07960: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: LX13658
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX13658%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for LX13658: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: VP59431
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP59431%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for VP59431: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: KG10310
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG10310%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for KG10310: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: EM43105
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM43105%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for EM43105: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: SL98070
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL98070%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for SL98070: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: UG29289
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG29289%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for UG29289: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: DH78566
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH78566%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for DH78566: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: DE78584
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE78584%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for DE78584: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: NN10692
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN10692%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for NN10692: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: VM73013
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM73013%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for VM73013: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: FN91376
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN91376%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for FN91376: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: AH74484
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH74484%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for AH74484: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: HK93279
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK93279%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for HK93279: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: VE41546
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE41546%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for VE41546: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: EJ62656
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ62656%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for EJ62656: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: BM42176
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM42176%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for BM42176: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: PK29781
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK29781%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for PK29781: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: SM62878
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM62878%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for SM62878: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: NE30408
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE30408%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for NE30408: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: ZC86187
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC86187%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for ZC86187: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: RK77836
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK77836%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for RK77836: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: SW09028
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW09028%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for SW09028: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: VF01529
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF01529%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for VF01529: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: ZC18028
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC18028%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for ZC18028: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: GH37532
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH37532%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for GH37532: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: UN95955
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN95955%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for UN95955: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: DS45210
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS45210%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for DS45210: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: ZD56270
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD56270%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.es] INFO: Scrape type for ZD56270: 0
2026-01-29 06:02:08 [auto1.es] INFO: Found listing with ID: DM54288
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM54288%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for DM54288: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: YC21611
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC21611%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for YC21611: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: YK49893
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK49893%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for YK49893: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: CN49784
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN49784%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for CN49784: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: TL86494
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL86494%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for TL86494: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: EP92466
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP92466%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for EP92466: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: DE51790
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51790%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for DE51790: 0
2026-01-29 06:02:09 [auto1.es] INFO: Found listing with ID: CC06310
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC06310%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Scrape type for CC06310: 0
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU48736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE56795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR71719> (referer: https://www.auto1.com/v1/car-details-view/YR71719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38c1040d-995b-5894-89e5-db91366e3382 with identifier: PX23975
2026-01-29 06:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38c1040d-995b-5894-89e5-db91366e3382 with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38c1040d-995b-5894-89e5-db91366e3382 with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38c1040d-995b-5894-89e5-db91366e3382, identifier: PX23975
2026-01-29 06:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38c1040d-995b-5894-89e5-db91366e3382 with identifier: PX23975
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38c1040d-995b-5894-89e5-db91366e3382 with identifier: PX23975
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159333 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159333
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 38c1040d-995b-5894-89e5-db91366e3382 spider: auto1.es
2026-01-29 06:02:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 38c1040d-995b-5894-89e5-db91366e3382 due to rule: high_mileage_for_country.json, error: 159333 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159333
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 75,
'expiration_date': '2026-01-29T16:12:21Z',
'fuel_type': 'petrol',
'id': '38c1040d-995b-5894-89e5-db91366e3382',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX23975',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 159333,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Fabia 1.0 MPI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2017}
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX23975%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.es] INFO: Saving data for PX23975: {'auction_closing_time': 1769703141.0, 'created_time': 1768912777.641575, 'last_price_update_time': 1769666529.497276}
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX23975') HTTP/1.1" 204 0
2026-01-29 06:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719
2026-01-29 06:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e033c467-e410-5ad2-a05c-260b031feb8a with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e033c467-e410-5ad2-a05c-260b031feb8a with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e033c467-e410-5ad2-a05c-260b031feb8a, identifier: YR71719
2026-01-29 06:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719
2026-01-29 06:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719 to the API
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YR71719>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:31:17Z',
'fuel_type': 'petrol',
'id': 'e033c467-e410-5ad2-a05c-260b031feb8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR71719',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Kia',
'model': 'XCeed',
'odometer': 147469,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-16',
'seats_number': 5,
'seller_name': None,
'title': 'Kia XCeed 1.0 TGDI Tech',
'transmission': 'manual',
'trim': 'Tech',
'year': 2019}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2026-01-29 06:02:10 [auto1.es] INFO: Saving data for YR71719: {'auction_closing_time': 1769704277.0, 'created_time': 1769162590.887974, 'last_price_update_time': 1769666530.06505}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR71719') HTTP/1.1" 204 0
2026-01-29 06:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV48377> (referer: https://www.auto1.com/v1/car-details-view/VV48377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX12180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU91578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA49493/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b49aa79-56c5-5438-ab04-6d127f211bea with identifier: VV48377
2026-01-29 06:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b49aa79-56c5-5438-ab04-6d127f211bea with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b49aa79-56c5-5438-ab04-6d127f211bea with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b49aa79-56c5-5438-ab04-6d127f211bea, identifier: VV48377
2026-01-29 06:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b49aa79-56c5-5438-ab04-6d127f211bea with identifier: VV48377
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b49aa79-56c5-5438-ab04-6d127f211bea with identifier: VV48377
2026-01-29 06:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b49aa79-56c5-5438-ab04-6d127f211bea with identifier: VV48377 to the API
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV48377>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:31:48Z',
'fuel_type': 'petrol',
'id': '5b49aa79-56c5-5438-ab04-6d127f211bea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV48377',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Seat',
'model': 'Leon',
'odometer': 48609,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48377%27 HTTP/1.1" 200 None
2026-01-29 06:02:10 [auto1.es] INFO: Saving data for VV48377: {'auction_closing_time': 1769704308.0, 'created_time': 1769447479.945785, 'last_price_update_time': 1769666530.592173}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV48377') HTTP/1.1" 204 0
2026-01-29 06:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ66849> (referer: https://www.auto1.com/v1/car-details-view/ZJ66849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN49290> (referer: https://www.auto1.com/v1/car-details-view/UN49290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329 with identifier: ZJ66849
2026-01-29 06:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329 with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329 with scrape type 2
2026-01-29 06:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329, identifier: ZJ66849
2026-01-29 06:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329 with identifier: ZJ66849
2026-01-29 06:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329 with identifier: ZJ66849
2026-01-29 06:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d14e0aeb-93e0-5d9e-9648-ac8fe1cc7329 with identifier: ZJ66849 to the API
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ66849>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 125,
'expiration_date': '2026-01-29T16:22:42Z',
'fuel_type': 'petrol',
'id': 'd14e0aeb-93e0-5d9e-9648-ac8fe1cc7329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ66849',
'listing': 'auction',
'location': 'Manacor',
'make': 'Seat',
'model': 'Leon',
'odometer': 98708,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR Plus',
'transmission': 'manual',
'trim': 'FR Plus',
'year': 2018}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ66849%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.es] INFO: Saving data for ZJ66849: {'auction_closing_time': 1769703762.0, 'created_time': 1768912933.429038, 'last_price_update_time': 1769666531.384283}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ66849') HTTP/1.1" 204 0
2026-01-29 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF26565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4e0d9b7-eea5-574f-893b-93e885ad1d25 with identifier: UN49290
2026-01-29 06:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4e0d9b7-eea5-574f-893b-93e885ad1d25 with scrape type 2
2026-01-29 06:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4e0d9b7-eea5-574f-893b-93e885ad1d25 with scrape type 2
2026-01-29 06:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4e0d9b7-eea5-574f-893b-93e885ad1d25, identifier: UN49290
2026-01-29 06:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4e0d9b7-eea5-574f-893b-93e885ad1d25 with identifier: UN49290
2026-01-29 06:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4e0d9b7-eea5-574f-893b-93e885ad1d25 with identifier: UN49290
2026-01-29 06:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4e0d9b7-eea5-574f-893b-93e885ad1d25 with identifier: UN49290 to the API
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN49290>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6A',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:44:27Z',
'fuel_type': 'petrol',
'id': 'a4e0d9b7-eea5-574f-893b-93e885ad1d25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN49290',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'make': 'Kia',
'model': 'Stonic',
'odometer': 29167,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Drive',
'transmission': 'automatic',
'trim': 'Drive',
'year': 2024}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN49290%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.es] INFO: Saving data for UN49290: {'auction_closing_time': 1769705067.0, 'created_time': 1765951284.720117, 'last_price_update_time': 1769666531.90373}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UN49290') HTTP/1.1" 204 0
2026-01-29 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW77816> (referer: https://www.auto1.com/v1/car-details-view/LW77816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC59242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH99836> (referer: https://www.auto1.com/v1/car-details-view/FH99836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN40641> (referer: https://www.auto1.com/v1/car-details-view/HN40641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88949dbe-cf12-5105-863a-6e38b1d25b83 with identifier: LW77816
2026-01-29 06:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88949dbe-cf12-5105-863a-6e38b1d25b83 with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88949dbe-cf12-5105-863a-6e38b1d25b83 with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88949dbe-cf12-5105-863a-6e38b1d25b83, identifier: LW77816
2026-01-29 06:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88949dbe-cf12-5105-863a-6e38b1d25b83 with identifier: LW77816
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-01-29 06:02:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88949dbe-cf12-5105-863a-6e38b1d25b83 with identifier: LW77816
2026-01-29 06:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88949dbe-cf12-5105-863a-6e38b1d25b83 with identifier: LW77816 to the API
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LW77816>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': 'Rental',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-01-29T16:50:22Z',
'fuel_type': 'petrol',
'id': '88949dbe-cf12-5105-863a-6e38b1d25b83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW77816',
'listing': 'auction',
'location': 'Málaga',
'make': 'Smart',
'model': 'fortwo',
'odometer': 127156,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-13',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW77816%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.es] INFO: Saving data for LW77816: {'auction_closing_time': 1769705422.0, 'created_time': 1769580067.103339, 'last_price_update_time': 1769666532.547478}
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LW77816') HTTP/1.1" 204 0
2026-01-29 06:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7beab99-1723-5630-bfec-88a8a4dae1db with identifier: FH99836
2026-01-29 06:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7beab99-1723-5630-bfec-88a8a4dae1db with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7beab99-1723-5630-bfec-88a8a4dae1db with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7beab99-1723-5630-bfec-88a8a4dae1db, identifier: FH99836
2026-01-29 06:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7beab99-1723-5630-bfec-88a8a4dae1db with identifier: FH99836
2026-01-29 06:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7beab99-1723-5630-bfec-88a8a4dae1db with identifier: FH99836
2026-01-29 06:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178380 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178380
2026-01-29 06:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c7beab99-1723-5630-bfec-88a8a4dae1db spider: auto1.es
2026-01-29 06:02:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c7beab99-1723-5630-bfec-88a8a4dae1db due to rule: high_mileage_for_country.json, error: 178380 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178380
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:47:43Z',
'fuel_type': 'diesel',
'id': 'c7beab99-1723-5630-bfec-88a8a4dae1db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH99836',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Peugeot',
'model': '3008',
'odometer': 178380,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH99836%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.es] INFO: Saving data for FH99836: {'auction_closing_time': 1769705263.0, 'created_time': 1768299517.227291, 'last_price_update_time': 1769666532.885341}
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH99836') HTTP/1.1" 204 0
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP20067> (referer: https://www.auto1.com/v1/car-details-view/SP20067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6e603e-103d-573e-becd-3e06abe384fc with identifier: HN40641
2026-01-29 06:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6e603e-103d-573e-becd-3e06abe384fc with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6e603e-103d-573e-becd-3e06abe384fc with scrape type 2
2026-01-29 06:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb6e603e-103d-573e-becd-3e06abe384fc, identifier: HN40641
2026-01-29 06:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb6e603e-103d-573e-becd-3e06abe384fc with identifier: HN40641
2026-01-29 06:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb6e603e-103d-573e-becd-3e06abe384fc with identifier: HN40641
2026-01-29 06:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bb6e603e-103d-573e-becd-3e06abe384fc spider: auto1.es
2026-01-29 06:02:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bb6e603e-103d-573e-becd-3e06abe384fc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-01-29T16:19:14Z',
'fuel_type': 'diesel',
'id': 'bb6e603e-103d-573e-becd-3e06abe384fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN40641',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 180498,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner 1.6 Blue-HDi Outdoor',
'transmission': 'manual',
'trim': 'Outdoor',
'year': 2017}
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN40641%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Saving data for HN40641: {'auction_closing_time': 1769703554.0, 'created_time': 1769447422.892435, 'last_price_update_time': 1769666533.207722}
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HN40641') HTTP/1.1" 204 0
2026-01-29 06:02:13 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57 with identifier: SP20067
2026-01-29 06:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57 with scrape type 2
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57 with scrape type 2
2026-01-29 06:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57, identifier: SP20067
2026-01-29 06:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57 with identifier: SP20067
2026-01-29 06:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57 with identifier: SP20067
2026-01-29 06:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 910fb2d3-7289-5cc6-b1b2-2fa91d6cea57 with identifier: SP20067 to the API
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SP20067>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:05:00Z',
'fuel_type': 'diesel',
'id': '910fb2d3-7289-5cc6-b1b2-2fa91d6cea57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP20067',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 54008,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP20067%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Saving data for SP20067: {'auction_closing_time': 1769702700.0, 'created_time': 1768928621.651396, 'last_price_update_time': 1769666533.63671}
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SP20067') HTTP/1.1" 204 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: KD77535
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD77535%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for KD77535: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: GE25563
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE25563%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for GE25563: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: YD18994
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD18994%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for YD18994: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: BG12504
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG12504%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for BG12504: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: BE42716
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE42716%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for BE42716: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: JX56992
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX56992%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for JX56992: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: VM98135
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM98135%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for VM98135: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: KL50046
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL50046%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for KL50046: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: XC93969
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC93969%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for XC93969: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: SW32457
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW32457%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for SW32457: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: MA72623
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA72623%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for MA72623: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: VF97209
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF97209%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for VF97209: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: RP64804
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP64804%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for RP64804: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: YA94679
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA94679%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for YA94679: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: LH94689
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH94689%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for LH94689: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: PA12525
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA12525%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for PA12525: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: UU16488
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU16488%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for UU16488: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: MP76578
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP76578%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.es] INFO: Scrape type for MP76578: 0
2026-01-29 06:02:13 [auto1.es] INFO: Found listing with ID: EG70285
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG70285%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for EG70285: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: FL45309
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL45309%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for FL45309: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: KN45266
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN45266%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for KN45266: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: MN81981
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN81981%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for MN81981: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: TL06212
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL06212%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for TL06212: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: SA65804
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA65804%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for SA65804: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: ET29682
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET29682%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for ET29682: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: PT57331
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT57331%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for PT57331: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: PX56700
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX56700%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for PX56700: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: KY66855
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY66855%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for KY66855: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: KX71919
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX71919%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for KX71919: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: CS74140
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS74140%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for CS74140: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: JT04116
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT04116%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for JT04116: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: CS07161
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS07161%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for CS07161: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: AM88870
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM88870%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for AM88870: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: TF79942
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF79942%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for TF79942: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: KH43607
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH43607%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for KH43607: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: DJ93903
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ93903%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for DJ93903: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: AX39994
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX39994%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for AX39994: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: PW29184
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW29184%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for PW29184: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: ZE32903
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE32903%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for ZE32903: 0
2026-01-29 06:02:14 [auto1.es] INFO: Found listing with ID: HS89445
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS89445%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Scrape type for HS89445: 0
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL80546> (referer: https://www.auto1.com/v1/car-details-view/UL80546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU48736> (referer: https://www.auto1.com/v1/car-details-view/SU48736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE56795> (referer: https://www.auto1.com/v1/car-details-view/VE56795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD52261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU91578> (referer: https://www.auto1.com/v1/car-details-view/BU91578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX12180> (referer: https://www.auto1.com/v1/car-details-view/RX12180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e295c9-87af-5f45-a17a-d8d3347c3566 with identifier: UL80546
2026-01-29 06:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e295c9-87af-5f45-a17a-d8d3347c3566 with scrape type 2
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e295c9-87af-5f45-a17a-d8d3347c3566 with scrape type 2
2026-01-29 06:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17e295c9-87af-5f45-a17a-d8d3347c3566, identifier: UL80546
2026-01-29 06:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17e295c9-87af-5f45-a17a-d8d3347c3566 with identifier: UL80546
2026-01-29 06:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17e295c9-87af-5f45-a17a-d8d3347c3566 with identifier: UL80546
2026-01-29 06:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 17e295c9-87af-5f45-a17a-d8d3347c3566 spider: auto1.es
2026-01-29 06:02:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 17e295c9-87af-5f45-a17a-d8d3347c3566 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:51:08Z',
'fuel_type': 'diesel',
'id': '17e295c9-87af-5f45-a17a-d8d3347c3566',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL80546',
'listing': 'auction',
'location': 'ES, Aldaya',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 84692,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
'transmission': 'manual',
'trim': 'Feel M',
'year': 2020}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL80546%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.es] INFO: Saving data for UL80546: {'auction_closing_time': 1769705468.0, 'created_time': 1769533423.07898, 'last_price_update_time': 1769666534.844736}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UL80546') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723 with identifier: SU48736
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723, identifier: SU48736
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c47d1d-739b-53e9-811c-3a0f146c4f14 with identifier: VE56795
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c47d1d-739b-53e9-811c-3a0f146c4f14 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92c47d1d-739b-53e9-811c-3a0f146c4f14 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92c47d1d-739b-53e9-811c-3a0f146c4f14, identifier: VE56795
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156dbd63-1194-5351-b942-3ccd7eefc213 with identifier: BU91578
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156dbd63-1194-5351-b942-3ccd7eefc213 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 156dbd63-1194-5351-b942-3ccd7eefc213 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 156dbd63-1194-5351-b942-3ccd7eefc213, identifier: BU91578
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f471d87e-8ce6-5aba-a67b-66d0efd62d3d with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f471d87e-8ce6-5aba-a67b-66d0efd62d3d with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f471d87e-8ce6-5aba-a67b-66d0efd62d3d, identifier: RX12180
2026-01-29 06:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723 with identifier: SU48736
2026-01-29 06:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723 with identifier: SU48736
2026-01-29 06:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ee3e1b9-3003-59c9-aac1-92cfa8ef9723 with identifier: SU48736 to the API
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU48736>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:55:17Z',
'fuel_type': 'petrol',
'id': '2ee3e1b9-3003-59c9-aac1-92cfa8ef9723',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU48736',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 92116,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2018}
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU48736%27 HTTP/1.1" 200 None
2026-01-29 06:02:15 [auto1.es] INFO: Saving data for SU48736: {'auction_closing_time': 1769705717.0, 'created_time': 1769447462.968363, 'last_price_update_time': 1769666535.717771}
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU48736') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92c47d1d-739b-53e9-811c-3a0f146c4f14 with identifier: VE56795
2026-01-29 06:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92c47d1d-739b-53e9-811c-3a0f146c4f14 with identifier: VE56795
2026-01-29 06:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151446 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151446
2026-01-29 06:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 92c47d1d-739b-53e9-811c-3a0f146c4f14 spider: auto1.es
2026-01-29 06:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 92c47d1d-739b-53e9-811c-3a0f146c4f14 due to rule: high_mileage_for_country.json, error: 151446 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151446
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-01-29T16:08:45Z',
'fuel_type': 'diesel',
'id': '92c47d1d-739b-53e9-811c-3a0f146c4f14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE56795',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 151446,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2018}
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE56795%27 HTTP/1.1" 200 None
2026-01-29 06:02:15 [auto1.es] INFO: Saving data for VE56795: {'auction_closing_time': 1769702925.0, 'created_time': 1769580038.748324, 'last_price_update_time': 1769666535.977383}
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VE56795') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 156dbd63-1194-5351-b942-3ccd7eefc213 with identifier: BU91578
2026-01-29 06:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 156dbd63-1194-5351-b942-3ccd7eefc213 with identifier: BU91578
2026-01-29 06:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 156dbd63-1194-5351-b942-3ccd7eefc213 with identifier: BU91578 to the API
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU91578>
{'auction_title': '',
'c_o_2_emission_value': 191,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 211,
'expiration_date': '2026-01-29T16:47:33Z',
'fuel_type': 'petrol',
'id': '156dbd63-1194-5351-b942-3ccd7eefc213',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU91578',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 73500,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU91578%27 HTTP/1.1" 200 None
2026-01-29 06:02:16 [auto1.es] INFO: Saving data for BU91578: {'auction_closing_time': 1769705253.0, 'created_time': 1769447080.986913, 'last_price_update_time': 1769666536.360594}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BU91578') HTTP/1.1" 204 0
2026-01-29 06:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180
2026-01-29 06:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180
2026-01-29 06:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180 to the API
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX12180>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-01-29T16:01:03Z',
'fuel_type': 'gas',
'id': 'f471d87e-8ce6-5aba-a67b-66d0efd62d3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX12180',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Opel',
'model': 'Corsa',
'odometer': 89066,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.4 LPG Design LINE',
'transmission': 'manual',
'trim': 'Design LINE',
'year': 2019}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX12180%27 HTTP/1.1" 200 None
2026-01-29 06:02:16 [auto1.es] INFO: Saving data for RX12180: {'auction_closing_time': 1769702463.0, 'created_time': 1769162629.367498, 'last_price_update_time': 1769666536.765786}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX12180') HTTP/1.1" 204 0
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA49493> (referer: https://www.auto1.com/v1/car-details-view/WA49493/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF26565> (referer: https://www.auto1.com/v1/car-details-view/UF26565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a92ececb-deab-53ed-8478-14dc34d8c121 with identifier: WA49493
2026-01-29 06:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a92ececb-deab-53ed-8478-14dc34d8c121 with scrape type 2
2026-01-29 06:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a92ececb-deab-53ed-8478-14dc34d8c121 with scrape type 2
2026-01-29 06:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a92ececb-deab-53ed-8478-14dc34d8c121, identifier: WA49493
2026-01-29 06:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a92ececb-deab-53ed-8478-14dc34d8c121 with identifier: WA49493
2026-01-29 06:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a92ececb-deab-53ed-8478-14dc34d8c121 with identifier: WA49493
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 57309, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wa49493', 'expiration_date': '2026-01-29t16:43:27z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'a92ececb-deab-53ed-8478-14dc34d8c121', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 57309}
Failed validating None in schema:
False
On instance:
{'age_in_months': 33,
'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2026-01-29t16:43:27z',
'fuel_type': 'petrol',
'id': 'a92ececb-deab-53ed-8478-14dc34d8c121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wa49493',
'listing': 'auction',
'location': 'es, madrid',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 57309,
'odometer_in_km': 57309,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-20',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a92ececb-deab-53ed-8478-14dc34d8c121 spider: auto1.es
2026-01-29 06:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a92ececb-deab-53ed-8478-14dc34d8c121 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 57309, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wa49493', 'expiration_date': '2026-01-29t16:43:27z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'a92ececb-deab-53ed-8478-14dc34d8c121', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 57309}
Failed validating None in schema:
False
On instance:
{'age_in_months': 33,
'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2026-01-29t16:43:27z',
'fuel_type': 'petrol',
'id': 'a92ececb-deab-53ed-8478-14dc34d8c121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wa49493',
'listing': 'auction',
'location': 'es, madrid',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 57309,
'odometer_in_km': 57309,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-20',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:43:27Z',
'fuel_type': 'petrol',
'id': 'a92ececb-deab-53ed-8478-14dc34d8c121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA49493',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Peugeot',
'model': '3008',
'odometer': 57309,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA49493%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Saving data for WA49493: {'auction_closing_time': 1769705007.0, 'created_time': 1769447109.847731, 'last_price_update_time': 1769666537.1982}
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA49493') HTTP/1.1" 204 0
2026-01-29 06:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 with identifier: UF26565
2026-01-29 06:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 with scrape type 2
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 with scrape type 2
2026-01-29 06:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f1eb790-b7aa-5989-9414-7bb5e1d22a93, identifier: UF26565
2026-01-29 06:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 with identifier: UF26565
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 with identifier: UF26565
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 spider: auto1.es
2026-01-29 06:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1f1eb790-b7aa-5989-9414-7bb5e1d22a93 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-01-29T16:29:20Z',
'fuel_type': 'diesel',
'id': '1f1eb790-b7aa-5989-9414-7bb5e1d22a93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF26565',
'listing': 'auction',
'location': 'ES, A Cañiza Pontevedra',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 138265,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-06',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot Partner 1.6 Blue-HDi L1 Komfort Plus',
'transmission': 'manual',
'trim': 'L1 Komfort Plus',
'year': 2018}
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF26565%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Saving data for UF26565: {'auction_closing_time': 1769704160.0, 'created_time': 1768323658.701345, 'last_price_update_time': 1769666537.517667}
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF26565') HTTP/1.1" 204 0
2026-01-29 06:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC59242> (referer: https://www.auto1.com/v1/car-details-view/FC59242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:17 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: MH75346
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH75346%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for MH75346: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: MJ22507
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22507%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for MJ22507: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: TS34361
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS34361%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for TS34361: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: NA02038
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA02038%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for NA02038: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: HL07550
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL07550%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for HL07550: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: GR78832
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78832%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for GR78832: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: PA70803
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA70803%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for PA70803: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: ZA44200
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA44200%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for ZA44200: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: WJ58793
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ58793%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for WJ58793: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: EL81396
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL81396%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for EL81396: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: TG55276
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG55276%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for TG55276: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: ML61701
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML61701%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for ML61701: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: FV87750
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV87750%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for FV87750: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: AK15257
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK15257%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for AK15257: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: WA73273
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73273%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for WA73273: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: YU72387
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU72387%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for YU72387: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: KN26353
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN26353%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for KN26353: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: UB28672
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB28672%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for UB28672: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: RV91175
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV91175%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for RV91175: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: BF11696
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF11696%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for BF11696: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: TV25666
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV25666%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for TV25666: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: TH64101
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH64101%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.es] INFO: Scrape type for TH64101: 0
2026-01-29 06:02:17 [auto1.es] INFO: Found listing with ID: YJ45268
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ45268%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for YJ45268: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: YF56333
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF56333%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for YF56333: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: PR87583
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR87583%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for PR87583: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: AV01801
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV01801%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for AV01801: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: WE01267
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE01267%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for WE01267: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: WC61871
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC61871%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for WC61871: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: VT87385
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT87385%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for VT87385: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: TC75424
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC75424%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for TC75424: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: BH83522
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH83522%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for BH83522: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: ZH31906
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH31906%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for ZH31906: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: SF21345
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF21345%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for SF21345: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: DY06551
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY06551%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for DY06551: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: SB20640
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB20640%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for SB20640: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: RT43870
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT43870%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for RT43870: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: TP24592
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP24592%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for TP24592: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: DN08712
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN08712%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for DN08712: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: FS52760
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS52760%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for FS52760: 0
2026-01-29 06:02:18 [auto1.es] INFO: Found listing with ID: RH54458
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH54458%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Scrape type for RH54458: 0
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55daed71-fbfb-5af6-ab07-62d8c07ba99b with identifier: FC59242
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55daed71-fbfb-5af6-ab07-62d8c07ba99b with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55daed71-fbfb-5af6-ab07-62d8c07ba99b with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55daed71-fbfb-5af6-ab07-62d8c07ba99b, identifier: FC59242
2026-01-29 06:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55daed71-fbfb-5af6-ab07-62d8c07ba99b with identifier: FC59242
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55daed71-fbfb-5af6-ab07-62d8c07ba99b with identifier: FC59242
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 55daed71-fbfb-5af6-ab07-62d8c07ba99b spider: auto1.es
2026-01-29 06:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 55daed71-fbfb-5af6-ab07-62d8c07ba99b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-29T16:50:15Z',
'fuel_type': 'diesel',
'id': '55daed71-fbfb-5af6-ab07-62d8c07ba99b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC59242',
'listing': 'auction',
'location': 'ES, Málaga',
'make': 'Opel',
'model': 'Combo',
'odometer': 61139,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-02',
'seats_number': 3,
'seller_name': None,
'title': 'Opel Combo 1.5 CDTI Select carga incrementada',
'transmission': 'manual',
'trim': 'Select carga incrementada',
'year': 2020}
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC59242%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.es] INFO: Saving data for FC59242: {'auction_closing_time': 1769705415.0, 'created_time': 1769014981.294081, 'last_price_update_time': 1769666538.664275}
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC59242') HTTP/1.1" 204 0
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD52261> (referer: https://www.auto1.com/v1/car-details-view/TD52261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0a21cc7-80c6-5d89-959b-ca29f095a1bf with identifier: TD52261
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0a21cc7-80c6-5d89-959b-ca29f095a1bf with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0a21cc7-80c6-5d89-959b-ca29f095a1bf with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0a21cc7-80c6-5d89-959b-ca29f095a1bf, identifier: TD52261
2026-01-29 06:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0a21cc7-80c6-5d89-959b-ca29f095a1bf with identifier: TD52261
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0a21cc7-80c6-5d89-959b-ca29f095a1bf with identifier: TD52261
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 11685, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td52261', 'expiration_date': '2026-01-29t16:18:38z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, granyanella', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': None, 'id': 'f0a21cc7-80c6-5d89-959b-ca29f095a1bf', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 11685}
Failed validating None in schema:
False
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2026-01-29t16:18:38z',
'fuel_type': 'petrol',
'id': 'f0a21cc7-80c6-5d89-959b-ca29f095a1bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td52261',
'listing': 'auction',
'location': 'es, granyanella',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 11685,
'odometer_in_km': 11685,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-17',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure pack',
'transmission': 'manual',
'trim': 'allure pack',
'year': 2023}
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f0a21cc7-80c6-5d89-959b-ca29f095a1bf spider: auto1.es
2026-01-29 06:02:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f0a21cc7-80c6-5d89-959b-ca29f095a1bf due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 11685, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td52261', 'expiration_date': '2026-01-29t16:18:38z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, granyanella', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': None, 'id': 'f0a21cc7-80c6-5d89-959b-ca29f095a1bf', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 11685}
Failed validating None in schema:
False
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2026-01-29t16:18:38z',
'fuel_type': 'petrol',
'id': 'f0a21cc7-80c6-5d89-959b-ca29f095a1bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td52261',
'listing': 'auction',
'location': 'es, granyanella',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 11685,
'odometer_in_km': 11685,
'odometer_reading_unit': 'km',
'origin_country_code': 'es',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-17',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure pack',
'transmission': 'manual',
'trim': 'allure pack',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:18:38Z',
'fuel_type': 'petrol',
'id': 'f0a21cc7-80c6-5d89-959b-ca29f095a1bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD52261',
'listing': 'auction',
'location': 'ES, Granyanella',
'make': 'Peugeot',
'model': '2008',
'odometer': 11685,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2023}
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD52261%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [auto1.es] INFO: Saving data for TD52261: {'auction_closing_time': 1769703518.0, 'created_time': 1769580040.902096, 'last_price_update_time': 1769666539.17831}
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TD52261') HTTP/1.1" 204 0
2026-01-29 06:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:19 [scrapy.extensions.logstats] INFO: Crawled 220 pages (at 129 pages/min), scraped 68 items (at 49 items/min)
2026-01-29 06:02:19 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:19 [auto1.es] INFO: Found listing with ID: ZG47270
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG47270%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [auto1.es] INFO: Scrape type for ZG47270: 0
2026-01-29 06:02:19 [auto1.es] INFO: Found listing with ID: LD09129
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD09129%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [auto1.es] INFO: Scrape type for LD09129: 0
2026-01-29 06:02:19 [auto1.es] INFO: Found listing with ID: EB78229
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB78229%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [auto1.es] INFO: Scrape type for EB78229: 0
2026-01-29 06:02:19 [auto1.es] INFO: Found listing with ID: RJ66193
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ66193%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for RJ66193: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: VP66018
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP66018%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for VP66018: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: JX65685
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX65685%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for JX65685: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: PT19275
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT19275%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for PT19275: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: JK22212
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK22212%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for JK22212: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: ZD98526
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98526%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for ZD98526: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: HT82047
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT82047%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for HT82047: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: GY84570
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY84570%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for GY84570: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: EY35323
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY35323%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for EY35323: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: PN18739
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN18739%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for PN18739: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: CV01854
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for CV01854: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: XM12351
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM12351%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for XM12351: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: EF63413
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF63413%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for EF63413: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: KP16326
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP16326%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for KP16326: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: CU45219
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU45219%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for CU45219: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: LP81684
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP81684%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for LP81684: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: BU80810
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU80810%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for BU80810: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: BK72365
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK72365%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for BK72365: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: BT53297
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for BT53297: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: KX91354
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX91354%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for KX91354: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: AL42304
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL42304%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for AL42304: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: WG59071
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for WG59071: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: VX11079
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX11079%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for VX11079: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: ZL80540
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for ZL80540: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: NW01202
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW01202%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for NW01202: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: SW47045
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW47045%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for SW47045: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: SU04753
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU04753%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for SU04753: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: YR92876
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR92876%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for YR92876: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: TS18952
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for TS18952: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: ZV19691
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV19691%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for ZV19691: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: AV92592
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV92592%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for AV92592: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: CN20473
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN20473%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for CN20473: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: XU17252
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU17252%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for XU17252: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: AG10753
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG10753%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for AG10753: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: EM12264
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM12264%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for EM12264: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: TS46537
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS46537%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for TS46537: 0
2026-01-29 06:02:20 [auto1.es] INFO: Found listing with ID: ZN75442
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN75442%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.es] INFO: Scrape type for ZN75442: 0
2026-01-29 06:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:21 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: UG06255
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG06255%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for UG06255: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: TP19820
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP19820%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for TP19820: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: SY38969
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY38969%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for SY38969: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: KB87556
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB87556%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for KB87556: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: HB59232
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB59232%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for HB59232: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: NK42155
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK42155%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for NK42155: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: EV50071
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV50071%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for EV50071: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: CX51290
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX51290%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for CX51290: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: YL08796
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL08796%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for YL08796: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: AT25707
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT25707%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for AT25707: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: YS21718
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21718%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for YS21718: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: BH79865
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH79865%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for BH79865: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: WU13655
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for WU13655: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: LU21979
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU21979%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for LU21979: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: XG14528
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG14528%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.es] INFO: Scrape type for XG14528: 0
2026-01-29 06:02:21 [auto1.es] INFO: Found listing with ID: HT97347
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for HT97347: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: FN63707
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN63707%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for FN63707: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: ZF50859
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF50859%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for ZF50859: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: CT67329
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT67329%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for CT67329: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: PK27651
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK27651%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for PK27651: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: TS38549
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS38549%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for TS38549: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: AR99640
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR99640%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for AR99640: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: YC26234
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC26234%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for YC26234: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: WB84696
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB84696%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for WB84696: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: ZL27489
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27489%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for ZL27489: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: CH50110
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for CH50110: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: YT08561
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT08561%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for YT08561: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: NY63222
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY63222%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for NY63222: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: NA90839
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for NA90839: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: EU50952
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU50952%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for EU50952: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: EN30281
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for EN30281: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: CL01909
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for CL01909: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: CT76222
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT76222%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for CT76222: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: VM39099
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM39099%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for VM39099: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: CV77036
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV77036%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for CV77036: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: MG09681
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG09681%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for MG09681: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: BK36177
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK36177%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for BK36177: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: FF90378
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF90378%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for FF90378: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: DP23605
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP23605%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for DP23605: 0
2026-01-29 06:02:22 [auto1.es] INFO: Found listing with ID: BG20996
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG20996%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.es] INFO: Scrape type for BG20996: 0
2026-01-29 06:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:23 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: ZU80420
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU80420%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for ZU80420: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: VK58231
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK58231%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for VK58231: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: LZ88191
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88191%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for LZ88191: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: WF67982
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF67982%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for WF67982: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: BU98177
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU98177%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for BU98177: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: JW59429
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW59429%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for JW59429: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: BB81076
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB81076%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for BB81076: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: KX84601
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX84601%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for KX84601: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: YL11886
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL11886%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for YL11886: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: VV60127
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV60127%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for VV60127: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: LJ42826
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ42826%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for LJ42826: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: FH92259
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH92259%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for FH92259: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: LP03049
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP03049%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for LP03049: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: RY15229
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15229%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for RY15229: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: KN94003
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN94003%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for KN94003: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: XG92427
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG92427%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for XG92427: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: FB61251
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB61251%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for FB61251: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: LK97600
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK97600%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for LK97600: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: YN61441
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN61441%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for YN61441: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: BW23029
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW23029%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for BW23029: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: TV38062
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV38062%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for TV38062: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: YW83541
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW83541%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for YW83541: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: RC89852
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC89852%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for RC89852: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: ZB83445
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB83445%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for ZB83445: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: PB42278
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB42278%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for PB42278: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: VP08909
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP08909%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for VP08909: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: GH53615
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53615%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for GH53615: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: DM35946
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM35946%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for DM35946: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: FH58137
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH58137%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for FH58137: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: WT57102
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT57102%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for WT57102: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: BW40922
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW40922%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for BW40922: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: CP16854
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16854%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.es] INFO: Scrape type for CP16854: 0
2026-01-29 06:02:23 [auto1.es] INFO: Found listing with ID: RD19726
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for RD19726: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: NS82424
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS82424%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for NS82424: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: YG61105
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG61105%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for YG61105: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: DL02134
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL02134%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for DL02134: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: KT38971
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT38971%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for KT38971: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: ZL71949
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL71949%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for ZL71949: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: LF74098
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF74098%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for LF74098: 0
2026-01-29 06:02:24 [auto1.es] INFO: Found listing with ID: BV41584
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV41584%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.es] INFO: Scrape type for BV41584: 0
2026-01-29 06:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: HY44668
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY44668%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for HY44668: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: HK65705
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK65705%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for HK65705: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: CH32569
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH32569%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for CH32569: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: RK21190
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK21190%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for RK21190: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: KF67108
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF67108%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for KF67108: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: ZL07637
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL07637%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for ZL07637: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: BD74245
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD74245%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for BD74245: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: DG13675
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG13675%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for DG13675: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: TB59452
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB59452%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for TB59452: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: DL66234
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL66234%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for DL66234: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: LW49246
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW49246%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for LW49246: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: JS12775
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS12775%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for JS12775: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: VX60212
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX60212%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for VX60212: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: XR29663
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR29663%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for XR29663: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: TK40804
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK40804%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for TK40804: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: DH09683
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH09683%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for DH09683: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: DH75586
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH75586%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for DH75586: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: EA12366
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA12366%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for EA12366: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: BP57031
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP57031%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for BP57031: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: YN21333
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN21333%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for YN21333: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: BE67955
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE67955%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for BE67955: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: BJ79125
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ79125%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for BJ79125: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: DE51179
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51179%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for DE51179: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: WU52604
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU52604%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for WU52604: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: XZ62505
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62505%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for XZ62505: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: FV98550
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for FV98550: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: FU11431
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU11431%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for FU11431: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: HL64379
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL64379%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for HL64379: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: MP30074
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP30074%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for MP30074: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: WJ13616
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13616%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for WJ13616: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: GL43713
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL43713%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for GL43713: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: DY55894
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY55894%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for DY55894: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: XZ84742
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ84742%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for XZ84742: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: AG21030
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG21030%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for AG21030: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: NW76363
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW76363%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for NW76363: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: VG50719
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG50719%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for VG50719: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: MG31491
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG31491%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for MG31491: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: GH68553
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH68553%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for GH68553: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: FG75667
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG75667%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for FG75667: 0
2026-01-29 06:02:25 [auto1.es] INFO: Found listing with ID: NA81137
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA81137%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.es] INFO: Scrape type for NA81137: 0
2026-01-29 06:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:26 [auto1.es] INFO: Found listing with ID: JU00551
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU00551%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.es] INFO: Scrape type for JU00551: 0
2026-01-29 06:02:26 [auto1.es] INFO: Found listing with ID: EV17776
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV17776%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.es] INFO: Scrape type for EV17776: 0
2026-01-29 06:02:26 [auto1.es] INFO: Found listing with ID: CW26445
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW26445%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.es] INFO: Scrape type for CW26445: 0
2026-01-29 06:02:26 [auto1.es] INFO: Found listing with ID: CV02777
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV02777%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.es] INFO: Scrape type for CV02777: 0
2026-01-29 06:02:26 [auto1.es] INFO: Found listing with ID: MA44811
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA44811%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for MA44811: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: SH03418
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for SH03418: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: HB41408
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB41408%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for HB41408: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: NB20063
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB20063%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for NB20063: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: VB61319
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB61319%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for VB61319: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: GK53380
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK53380%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for GK53380: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: EK01872
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK01872%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for EK01872: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: DS85202
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS85202%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for DS85202: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: EN27653
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN27653%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for EN27653: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: GM17257
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM17257%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for GM17257: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: PC27245
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC27245%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for PC27245: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: PF38701
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF38701%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for PF38701: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: EY58964
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY58964%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for EY58964: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: AR26127
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR26127%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for AR26127: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: HZ84403
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84403%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for HZ84403: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: RM01009
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM01009%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for RM01009: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: NF79816
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79816%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for NF79816: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: ND01122
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND01122%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for ND01122: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: SL25416
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL25416%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for SL25416: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: AN08984
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN08984%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for AN08984: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: BL95090
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL95090%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for BL95090: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: NF45409
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF45409%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for NF45409: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: KN50898
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50898%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for KN50898: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: DR04580
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR04580%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for DR04580: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: UE26475
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE26475%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for UE26475: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: SG65714
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG65714%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for SG65714: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: LV49535
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49535%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for LV49535: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: ZL23316
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL23316%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for ZL23316: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: LX91241
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX91241%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for LX91241: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: XF05648
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF05648%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for XF05648: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: NG68284
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG68284%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for NG68284: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: XZ16571
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ16571%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for XZ16571: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: KU77979
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU77979%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for KU77979: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: RZ25182
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ25182%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for RZ25182: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: SY95486
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY95486%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for SY95486: 0
2026-01-29 06:02:27 [auto1.es] INFO: Found listing with ID: WR98337
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR98337%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.es] INFO: Scrape type for WR98337: 0
2026-01-29 06:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:28 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: EY27652
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY27652%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for EY27652: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: AF70499
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF70499%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for AF70499: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: LV66931
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV66931%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for LV66931: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: GN42445
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN42445%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for GN42445: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: TY04306
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY04306%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for TY04306: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: ZP90682
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP90682%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for ZP90682: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: UZ13447
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ13447%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for UZ13447: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: ES71319
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES71319%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for ES71319: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: PB23846
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB23846%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.es] INFO: Scrape type for PB23846: 0
2026-01-29 06:02:28 [auto1.es] INFO: Found listing with ID: CL61096
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL61096%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for CL61096: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: GU10653
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU10653%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for GU10653: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: UX61881
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX61881%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for UX61881: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: ZG30508
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG30508%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for ZG30508: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: PD89077
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD89077%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for PD89077: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: HG47360
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47360%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for HG47360: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: PM05949
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM05949%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for PM05949: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: EM36391
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM36391%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for EM36391: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: BJ25544
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ25544%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for BJ25544: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: FU92105
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU92105%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for FU92105: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: LF16630
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF16630%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for LF16630: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: XJ12820
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for XJ12820: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: NK39873
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK39873%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for NK39873: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: UW92263
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UW92263%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for UW92263: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: YY55066
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY55066%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for YY55066: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: NJ80936
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ80936%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for NJ80936: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: JG49052
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG49052%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for JG49052: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: BP86334
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP86334%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for BP86334: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: XX30070
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX30070%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for XX30070: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: RJ22818
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ22818%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for RJ22818: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: VY28267
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for VY28267: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: DF95857
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95857%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for DF95857: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: FW12550
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW12550%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for FW12550: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: SU76295
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU76295%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for SU76295: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: WU95928
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU95928%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for WU95928: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: TU48427
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU48427%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for TU48427: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: BR03332
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR03332%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for BR03332: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: AB74066
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB74066%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for AB74066: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: AC08387
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC08387%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for AC08387: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: LD85215
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD85215%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for LD85215: 0
2026-01-29 06:02:29 [auto1.es] INFO: Found listing with ID: FZ98795
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ98795%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.es] INFO: Scrape type for FZ98795: 0
2026-01-29 06:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:34 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: GH73638
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH73638%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for GH73638: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: JW95556
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW95556%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for JW95556: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: PX76519
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX76519%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for PX76519: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: AH18872
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH18872%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for AH18872: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: TB32811
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB32811%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for TB32811: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: FB08932
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB08932%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for FB08932: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: PH24007
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH24007%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for PH24007: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: ME28705
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME28705%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for ME28705: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: EW08330
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW08330%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for EW08330: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: KL07706
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL07706%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for KL07706: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: UL07014
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL07014%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.es] INFO: Scrape type for UL07014: 0
2026-01-29 06:02:34 [auto1.es] INFO: Found listing with ID: SD57471
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD57471%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for SD57471: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: HM90480
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM90480%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for HM90480: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: TN12809
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN12809%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for TN12809: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: GD68452
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD68452%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for GD68452: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: FM65148
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM65148%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for FM65148: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: SM82482
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM82482%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for SM82482: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: TR17798
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR17798%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for TR17798: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: ES82633
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES82633%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for ES82633: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: RV71834
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV71834%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for RV71834: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: BR83507
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR83507%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for BR83507: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: PH10774
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for PH10774: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: YU81680
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU81680%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for YU81680: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: NJ71471
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ71471%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for NJ71471: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: LP64898
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP64898%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for LP64898: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: XD08126
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD08126%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for XD08126: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: VT60667
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT60667%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for VT60667: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: LA81893
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA81893%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for LA81893: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: YV54140
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV54140%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for YV54140: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: UK62633
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK62633%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for UK62633: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: ND84609
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND84609%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for ND84609: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: VR29926
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for VR29926: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: DM21267
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM21267%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for DM21267: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: CH74884
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH74884%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for CH74884: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: AE99486
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE99486%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for AE99486: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: UX97052
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX97052%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for UX97052: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: AL50426
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL50426%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for AL50426: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: NP31534
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP31534%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for NP31534: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: LM22343
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM22343%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for LM22343: 0
2026-01-29 06:02:35 [auto1.es] INFO: Found listing with ID: YC11902
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC11902%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.es] INFO: Scrape type for YC11902: 0
2026-01-29 06:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:36 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: HV22353
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV22353%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for HV22353: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: NN14393
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN14393%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for NN14393: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: CF88486
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF88486%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for CF88486: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: HA84402
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA84402%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for HA84402: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: HY66255
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY66255%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for HY66255: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: AY15178
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY15178%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for AY15178: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: GL69092
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL69092%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for GL69092: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: DV21475
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV21475%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for DV21475: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: YJ38714
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ38714%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for YJ38714: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: XR99228
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR99228%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for XR99228: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: TE12893
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE12893%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for TE12893: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: JB57039
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB57039%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for JB57039: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: AA89262
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA89262%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for AA89262: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: RM03359
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM03359%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for RM03359: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: XT95954
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT95954%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for XT95954: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: VA57807
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA57807%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for VA57807: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: GX71832
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX71832%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for GX71832: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: CA66568
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA66568%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for CA66568: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: GZ80294
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ80294%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for GZ80294: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: DH47763
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH47763%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for DH47763: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: VT13561
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT13561%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for VT13561: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: ED84025
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED84025%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.es] INFO: Scrape type for ED84025: 0
2026-01-29 06:02:36 [auto1.es] INFO: Found listing with ID: MW11929
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW11929%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for MW11929: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: EV88095
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV88095%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for EV88095: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: LH71746
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH71746%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for LH71746: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: YU15845
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU15845%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for YU15845: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: AG92925
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG92925%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for AG92925: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: HC54242
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC54242%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for HC54242: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: XL70803
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL70803%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for XL70803: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: FC31020
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC31020%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for FC31020: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: UN99585
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN99585%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for UN99585: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: AS88754
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS88754%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for AS88754: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: ZD50778
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD50778%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for ZD50778: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: UT52372
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT52372%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for UT52372: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: GW05741
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW05741%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for GW05741: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: MG50148
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG50148%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for MG50148: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: EY99045
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY99045%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for EY99045: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: JS62552
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS62552%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for JS62552: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: MB07340
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB07340%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for MB07340: 0
2026-01-29 06:02:37 [auto1.es] INFO: Found listing with ID: NT91356
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT91356%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.es] INFO: Scrape type for NT91356: 0
2026-01-29 06:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: YN68202
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN68202%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for YN68202: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: YA70730
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA70730%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for YA70730: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: SU69829
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU69829%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for SU69829: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: WF99356
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF99356%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for WF99356: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: YA06630
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA06630%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for YA06630: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: XH60546
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH60546%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for XH60546: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: GV99181
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV99181%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for GV99181: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: GS13880
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS13880%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for GS13880: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: NM62310
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM62310%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for NM62310: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: ZP66767
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP66767%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for ZP66767: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: XV04489
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV04489%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for XV04489: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: SE18211
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE18211%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for SE18211: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: DT57458
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT57458%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for DT57458: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: RF90830
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF90830%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for RF90830: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: LN42337
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN42337%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for LN42337: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: BE48762
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE48762%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for BE48762: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: ME67381
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME67381%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for ME67381: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: UP80537
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP80537%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for UP80537: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: DN99031
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN99031%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for DN99031: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: YJ21856
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ21856%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for YJ21856: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: SK27491
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK27491%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for SK27491: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: KK12826
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK12826%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for KK12826: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: BD44007
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD44007%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for BD44007: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: RX82607
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82607%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for RX82607: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: BJ75970
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ75970%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for BJ75970: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: GV12563
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV12563%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for GV12563: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: HE21672
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE21672%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for HE21672: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: EE15765
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE15765%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for EE15765: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: KR69739
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR69739%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for KR69739: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: NR83625
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR83625%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for NR83625: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: ZW51113
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW51113%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for ZW51113: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: KK01893
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK01893%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.es] INFO: Scrape type for KK01893: 0
2026-01-29 06:02:38 [auto1.es] INFO: Found listing with ID: TP66623
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP66623%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for TP66623: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: CV43839
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV43839%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for CV43839: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: NE64974
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE64974%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for NE64974: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: XZ85086
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ85086%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for XZ85086: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: BG65437
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG65437%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for BG65437: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: TL18663
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL18663%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for TL18663: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: GF81811
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF81811%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for GF81811: 0
2026-01-29 06:02:39 [auto1.es] INFO: Found listing with ID: EZ00627
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ00627%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.es] INFO: Scrape type for EZ00627: 0
2026-01-29 06:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: ZL85461
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL85461%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for ZL85461: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: FM61174
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM61174%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for FM61174: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: XD38373
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD38373%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for XD38373: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: UG89519
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG89519%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for UG89519: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: US94086
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US94086%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for US94086: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: FB84319
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB84319%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for FB84319: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: HH63852
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH63852%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for HH63852: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: TB29205
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB29205%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for TB29205: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: CP17401
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP17401%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for CP17401: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: GN19670
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN19670%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for GN19670: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: CG62128
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG62128%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for CG62128: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: ZB71689
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB71689%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for ZB71689: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: EE02681
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE02681%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for EE02681: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: PY48154
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY48154%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for PY48154: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: AL99452
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL99452%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for AL99452: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: VD07313
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD07313%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for VD07313: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: FU04636
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU04636%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for FU04636: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: RJ21512
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ21512%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for RJ21512: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: RZ61844
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ61844%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for RZ61844: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: AJ41556
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ41556%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for AJ41556: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: DX90294
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX90294%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for DX90294: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: ZF58573
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF58573%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for ZF58573: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: TD74745
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD74745%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for TD74745: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: WY87549
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY87549%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for WY87549: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: HD00018
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD00018%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for HD00018: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: NC81408
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC81408%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for NC81408: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: LX25813
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX25813%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for LX25813: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: GC80104
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC80104%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for GC80104: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: NM49445
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM49445%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for NM49445: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: GJ14568
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ14568%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for GJ14568: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: FH33557
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH33557%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for FH33557: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: MH96539
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH96539%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for MH96539: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: XL99979
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL99979%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for XL99979: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: YB95625
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB95625%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for YB95625: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: FX90813
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX90813%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for FX90813: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: BV37425
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV37425%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for BV37425: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: JC57024
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC57024%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for JC57024: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: KP50640
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP50640%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for KP50640: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: EC42327
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC42327%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for EC42327: 0
2026-01-29 06:02:40 [auto1.es] INFO: Found listing with ID: LY61311
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY61311%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.es] INFO: Scrape type for LY61311: 0
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:41 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: JB20190
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB20190%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.es] INFO: Scrape type for JB20190: 0
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: RZ88845
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ88845%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.es] INFO: Scrape type for RZ88845: 0
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: DL86494
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL86494%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.es] INFO: Scrape type for DL86494: 0
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: PA82010
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA82010%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.es] INFO: Scrape type for PA82010: 0
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: EM14383
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM14383%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.es] INFO: Scrape type for EM14383: 0
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: CZ86018
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ86018%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.es] INFO: Scrape type for CZ86018: 0
2026-01-29 06:02:41 [auto1.es] INFO: Found listing with ID: UL25589
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL25589%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for UL25589: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: PS03638
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS03638%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for PS03638: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: LR65108
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR65108%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for LR65108: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: GX15392
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX15392%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for GX15392: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: XU50819
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU50819%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for XU50819: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: JW99800
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW99800%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for JW99800: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: FU94451
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU94451%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for FU94451: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: NR44611
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR44611%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for NR44611: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: ZD97548
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD97548%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for ZD97548: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: GT01494
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT01494%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for GT01494: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: EN57329
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN57329%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for EN57329: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: UT91122
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT91122%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for UT91122: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: CM10234
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM10234%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for CM10234: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: KH31340
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH31340%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for KH31340: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: ML88994
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML88994%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for ML88994: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: FN07942
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN07942%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for FN07942: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: YA52263
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA52263%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for YA52263: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: UT31278
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT31278%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for UT31278: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: WW85834
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW85834%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for WW85834: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: SG12491
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG12491%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for SG12491: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: PA61083
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA61083%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for PA61083: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: TC12412
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC12412%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for TC12412: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: ZM36489
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM36489%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for ZM36489: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: XW32835
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW32835%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for XW32835: 0
2026-01-29 06:02:42 [auto1.es] INFO: Found listing with ID: DB35295
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB35295%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.es] INFO: Scrape type for DB35295: 0
2026-01-29 06:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:43 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-29 06:02:43 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 431}
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201769234563 HTTP/1.1" 200 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AB84755') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AW35806') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AZ18067') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BY60416') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DH96701') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DK43536') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DN14156') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DV19753') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EL50469') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FM57181') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HY05529') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JL67783') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JR25828') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LA26360') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LD80676') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LE39074') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LT10093') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MD81578') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MN75897') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MR56124') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ95396') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ND21525') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NY20257') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ07696') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RW99502') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TB05922') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TP70940') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UR95745') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UX90577') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VN63485') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WE89435') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WF07527') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WP69418') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ02002') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ58200') HTTP/1.1" 204 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE34783') HTTP/1.1" 204 0
2026-01-29 06:02:44 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (68 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_25_2026-01-29T06_00_01.jl
2026-01-29 06:02:44 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 664807,
'downloader/request_count': 343,
'downloader/request_method_count/GET': 314,
'downloader/request_method_count/POST': 29,
'downloader/response_bytes': 22817069,
'downloader/response_count': 343,
'downloader/response_status_count/200': 343,
'dupefilter/filtered': 34,
'elapsed_time_seconds': 144.141926,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 1, 29, 6, 2, 43, 979783, tzinfo=datetime.timezone.utc),
'item_dropped_count': 32,
'item_dropped_reasons_count/DropItem': 32,
'item_scraped_count': 68,
'log_count/DEBUG': 4709,
'log_count/INFO': 4268,
'memusage/max': 168398848,
'memusage/startup': 126955520,
'photo_download_count': 112,
'request_depth_max': 30,
'response_received_count': 231,
'scheduler/dequeued': 343,
'scheduler/dequeued/memory': 343,
'scheduler/enqueued': 343,
'scheduler/enqueued/memory': 343,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 231,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.3116766496912224,
'scrapy-zyte-api/mean_response_seconds': 3.3425905460459524,
'scrapy-zyte-api/processed': 231,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 231,
'scrapy-zyte-api/request_args/experimental.requestCookies': 230,
'scrapy-zyte-api/request_args/experimental.responseCookies': 231,
'scrapy-zyte-api/request_args/httpRequestBody': 29,
'scrapy-zyte-api/request_args/httpRequestMethod': 29,
'scrapy-zyte-api/request_args/httpResponseBody': 231,
'scrapy-zyte-api/request_args/httpResponseHeaders': 231,
'scrapy-zyte-api/request_args/sessionContext': 231,
'scrapy-zyte-api/request_args/url': 231,
'scrapy-zyte-api/status_codes/200': 231,
'scrapy-zyte-api/success': 231,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 1, 29, 6, 0, 19, 837857, tzinfo=datetime.timezone.utc)}
2026-01-29 06:02:44 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-29 06:02:44 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f065ddd6f10>
2026-01-29 06:02:44 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f065d941310>