2026-03-28 11:05:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 11:05:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 11:05:04 [auto1.es] INFO: Batch mode enabled: batch 2/2
2026-03-28 11:05:04 [auto1.es] INFO: Starting spider auto1.es
2026-03-28 11:05:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 11:05:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 11:05:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 11:05:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 11:05:04 [scrapy.extensions.telnet] INFO: Telnet Password: fc61fc1bfa2cf821
2026-03-28 11:05:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 11:05:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_22_2026-03-28T11_05_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 11:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:05:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 11:05:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 11:05:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-28 11:05:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 11:05:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 11:05:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 11:05:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 11:05:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 11:05:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 11:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 11:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 11:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 11:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 11:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 11:05:14 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2555 | hits on page: 40
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: AW26906
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: BF82684
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF82684%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for BF82684: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: JN16141
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN16141%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for JN16141: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: RE29158
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE29158%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for RE29158: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: XM37259
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM37259%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for XM37259: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: DD08743
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB84722%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for MB84722: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ76741%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for LJ76741: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY16878%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for MY16878: 1
2026-03-28 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:14 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR36141%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.es] INFO: Scrape type for SR36141: 2
2026-03-28 11:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141
2026-03-28 11:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83059e13-8b66-57e7-866a-ff8c344857a6 with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83059e13-8b66-57e7-866a-ff8c344857a6 with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83059e13-8b66-57e7-866a-ff8c344857a6, identifier: SR36141
2026-03-28 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141 to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:03:59Z',
 'fuel_type': 'diesel',
 'id': '83059e13-8b66-57e7-866a-ff8c344857a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR36141',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 40370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR36141%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.es] INFO: Saving data for SR36141: {'auction_closing_time': 1774883039.0, 'created_time': 1774102053.767162, 'last_price_update_time': 1774695915.245461}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR36141') HTTP/1.1" 204 0
2026-03-28 11:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB86701%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.es] INFO: Scrape type for UB86701: 2
2026-03-28 11:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701
2026-03-28 11:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597, identifier: UB86701
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701 to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:03:37Z',
 'fuel_type': 'petrol',
 'id': '5581c6ab-43c6-5edf-b0a6-31c1a6af0597',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB86701',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 73110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2021}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB86701%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.es] INFO: Saving data for UB86701: {'auction_closing_time': 1774883017.0, 'created_time': 1773432419.263659, 'last_price_update_time': 1774695915.924255}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB86701') HTTP/1.1" 204 0
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17964%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.es] INFO: Scrape type for KL17964: 1
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM08693%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.es] INFO: Scrape type for NM08693: 1
2026-03-28 11:05:15 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM24927%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.es] INFO: Scrape type for MM24927: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ60367%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for AZ60367: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH03748%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for EH03748: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF33961%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for GF33961: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX69665%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for FX69665: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV64390%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for NV64390: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH53722%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for UH53722: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP31470%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for HP31470: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE66788%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for PE66788: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA65207%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for WA65207: 1
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE29158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB84722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ76741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM37259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN16141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2555 | hits on page: 40
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: AW26906
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: BF82684
2026-03-28 11:05:16 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/BF82684/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: JN16141
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF82684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: RE29158
2026-03-28 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: XM37259
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: DD08743
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR36141%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for SR36141: 0
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB86701%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.es] INFO: Scrape type for UB86701: 0
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-28 11:05:16 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-28 11:05:17 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-28 11:05:17 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-28 11:05:17 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-28 11:05:17 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-28 11:05:17 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-28 11:05:17 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM24927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH03748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ60367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL17964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM08693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF33961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX69665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV64390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY16878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE66788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ76741> (referer: https://www.auto1.com/v1/car-details-view/LJ76741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA65207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE29158> (referer: https://www.auto1.com/v1/car-details-view/RE29158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26591f7a-c0d4-563a-8053-ea96c484618f with identifier: LJ76741
2026-03-28 11:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26591f7a-c0d4-563a-8053-ea96c484618f with scrape type 1
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26591f7a-c0d4-563a-8053-ea96c484618f
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_fdb71fa295a73221125faa62b14e86d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_fdb71fa295a73221125faa62b14e86d7.jpg not downloaded yet
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_b8b9b70dc65d921b592590b05362a46b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b8b9b70dc65d921b592590b05362a46b.jpg not downloaded yet
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg not downloaded yet
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_8116a2a683681ee7b214e0c391c005d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_8116a2a683681ee7b214e0c391c005d7.jpg not downloaded yet
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB84722> (referer: https://www.auto1.com/v1/car-details-view/MB84722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd77e97-e526-57a7-8404-362f17856991 with identifier: RE29158
2026-03-28 11:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd77e97-e526-57a7-8404-362f17856991 with scrape type 1
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fcd77e97-e526-57a7-8404-362f17856991
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg not downloaded yet
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_b23e814dd667fb6d8428cdf4cd73a676.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b23e814dd667fb6d8428cdf4cd73a676.jpg not downloaded yet
2026-03-28 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_6c6622f2722faad91e86871a9c197900.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_6c6622f2722faad91e86871a9c197900.jpg not downloaded yet
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP31470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg not downloaded yet
2026-03-28 11:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_9d8319331c46ad6d2678dd8936d67e29.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_9d8319331c46ad6d2678dd8936d67e29.jpg not downloaded yet
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_2486fe68274ba03f7e34f29e75ceb2d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2486fe68274ba03f7e34f29e75ceb2d0.jpg not downloaded yet
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_2180e17acda5d262b9a832412140a45a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_2180e17acda5d262b9a832412140a45a.jpg not downloaded yet
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_06abf1637036c846479dcbacf4de82d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_06abf1637036c846479dcbacf4de82d3.jpg not downloaded yet
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_41a91a8c5bdda7b5eba1d71ded28f28d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_41a91a8c5bdda7b5eba1d71ded28f28d.jpg not downloaded yet
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-03-28 11:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d29d70-4752-50ba-bba2-3736a46e3c8c with scrape type 1
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95d29d70-4752-50ba-bba2-3736a46e3c8c
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_483e141c5803743360b36dabd437e1cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_483e141c5803743360b36dabd437e1cf.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_5045679ae018ff6a9e37df90edf68d88.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_5045679ae018ff6a9e37df90edf68d88.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_193f2a441345889a6c796a124cc4fdc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_193f2a441345889a6c796a124cc4fdc8.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_581cac7a239f51ca04a8901b4848cc11.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_581cac7a239f51ca04a8901b4848cc11.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_60936c1445f68ca465f9a896c66a4b85.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_60936c1445f68ca465f9a896c66a4b85.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_8bab9e429a3c60b6880a88d65bbbb46a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_8bab9e429a3c60b6880a88d65bbbb46a.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_744fc2a6cac18f3dda74974ca6da3632.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_744fc2a6cac18f3dda74974ca6da3632.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_1941c3e16e0d260cab9976776bf11e50.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_1941c3e16e0d260cab9976776bf11e50.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_7bcb0be1de8ba251b46f189f03a2e034.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_7bcb0be1de8ba251b46f189f03a2e034.jpg already downloaded
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fea%252F2bea3b54a42f018052f9db91add65962%252Fpa%252FMB84722_204d8562d4dd8c8f4b2aecc8dd082a27.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_204d8562d4dd8c8f4b2aecc8dd082a27.jpg already downloaded
2026-03-28 11:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95d29d70-4752-50ba-bba2-3736a46e3c8c, identifier: MB84722
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_c2bb40baa8d19545629743dba7ae92cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_c2bb40baa8d19545629743dba7ae92cb.jpg not downloaded yet
2026-03-28 11:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-03-28 11:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722 to the API
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB84722>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:22Z',
 'fuel_type': 'diesel',
 'id': '95d29d70-4752-50ba-bba2-3736a46e3c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB84722',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 125463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_483e141c5803743360b36dabd437e1cf.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_5045679ae018ff6a9e37df90edf68d88.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_193f2a441345889a6c796a124cc4fdc8.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_581cac7a239f51ca04a8901b4848cc11.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_60936c1445f68ca465f9a896c66a4b85.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_8bab9e429a3c60b6880a88d65bbbb46a.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_744fc2a6cac18f3dda74974ca6da3632.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_1941c3e16e0d260cab9976776bf11e50.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_7bcb0be1de8ba251b46f189f03a2e034.jpg',
                'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_204d8562d4dd8c8f4b2aecc8dd082a27.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_483e141c5803743360b36dabd437e1cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_5045679ae018ff6a9e37df90edf68d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_193f2a441345889a6c796a124cc4fdc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_581cac7a239f51ca04a8901b4848cc11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_60936c1445f68ca465f9a896c66a4b85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_8bab9e429a3c60b6880a88d65bbbb46a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_744fc2a6cac18f3dda74974ca6da3632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_1941c3e16e0d260cab9976776bf11e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_7bcb0be1de8ba251b46f189f03a2e034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d29d70-4752-50ba-bba2-3736a46e3c8c/95d29d70-4752-50ba-bba2-3736a46e3c8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/ea/2bea3b54a42f018052f9db91add65962/pa/MB84722_204d8562d4dd8c8f4b2aecc8dd082a27.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2018}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB84722%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.es] INFO: Saving data for MB84722: {'created_time': 1774695920.046347, 'last_price_update_time': 1774695920.046359, 'auction_closing_time': 1774885102.0}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MB84722') HTTP/1.1" 204 0
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 26591f7a-c0d4-563a-8053-ea96c484618f due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_22a38cc9ef0dd50e2a152d8db5473771.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_22a38cc9ef0dd50e2a152d8db5473771.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_3523d43f74a992384b1c9b3aa989198b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_3523d43f74a992384b1c9b3aa989198b.jpg not downloaded yet
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH03748> (referer: https://www.auto1.com/v1/car-details-view/EH03748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF82684> (referer: https://www.auto1.com/v1/car-details-view/BF82684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM24927> (referer: https://www.auto1.com/v1/car-details-view/MM24927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN16141> (referer: https://www.auto1.com/v1/car-details-view/JN16141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item fcd77e97-e526-57a7-8404-362f17856991 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b134e5f-7685-5c85-a18a-01a3c81b1594 with identifier: EH03748
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b134e5f-7685-5c85-a18a-01a3c81b1594 with scrape type 1
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_78c37d76339a62335b74dec3299c9126.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_78c37d76339a62335b74dec3299c9126.jpg not downloaded yet
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 with identifier: BF82684
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 with scrape type 1
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg not downloaded yet
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01359fed-d4b0-5252-ba34-9ce842217476 with identifier: MM24927
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01359fed-d4b0-5252-ba34-9ce842217476 with scrape type 1
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg not downloaded yet
2026-03-28 11:05:20 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2555 | hits on page: 40
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e7b08d-45d3-553e-9f3b-5a6fb969de3a with identifier: JN16141
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a with scrape type 1
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_d4ee87c888fa82df34041c1f6458d00f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_d4ee87c888fa82df34041c1f6458d00f.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_fa158e0adb0c07702dad637e474ff40b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_fa158e0adb0c07702dad637e474ff40b.jpg not downloaded yet
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_1b5c3544bdf26784bef0ca568362dd2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1b5c3544bdf26784bef0ca568362dd2f.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_74cb13b18023f0b25e75679e8a39ae1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_74cb13b18023f0b25e75679e8a39ae1e.jpg not downloaded yet
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: RR07700
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR07700%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.es] INFO: Scrape type for RR07700: 1
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_57b2d320438dbec123f896156d677578.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_57b2d320438dbec123f896156d677578.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_747443cfa5bb2d6bb2f5e2eb5650f144.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_747443cfa5bb2d6bb2f5e2eb5650f144.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_a866018fc3e9f2118688e8623cc644e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a866018fc3e9f2118688e8623cc644e2.jpg not downloaded yet
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: FR94321
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: UA24744
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: US29597
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US29597%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.es] INFO: Scrape type for US29597: 1
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_1662067788f27a4e12a77afda5db4a9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_1662067788f27a4e12a77afda5db4a9a.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_9360f97df5934bd9ecd5aec4b178f786.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_9360f97df5934bd9ecd5aec4b178f786.jpg not downloaded yet
2026-03-28 11:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 11:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 11:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85f5dd0>
2026-03-28 11:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd77e97-e526-57a7-8404-362f17856991/fcd77e97-e526-57a7-8404-362f17856991_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg saved to cache
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcd77e97-e526-57a7-8404-362f17856991
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_f21b8e393f1b65214e535f000fd4c104.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_f21b8e393f1b65214e535f000fd4c104.jpg not downloaded yet
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_1c4b68e152cb3ee76f11204af057264a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_1c4b68e152cb3ee76f11204af057264a.jpg not downloaded yet
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: NJ67875
2026-03-28 11:05:20 [auto1.es] INFO: Found listing with ID: XF82752
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF82752%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.es] INFO: Scrape type for XF82752: 1
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_28c3d453e5620d22556143083ca818f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_28c3d453e5620d22556143083ca818f3.jpg not downloaded yet
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_d4ee87c888fa82df34041c1f6458d00f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_f758d59de74b9ff370417b4de95efaa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_f758d59de74b9ff370417b4de95efaa3.jpg not downloaded yet
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_e681229f5f9a15f5d0cab84ec923d551.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_e681229f5f9a15f5d0cab84ec923d551.jpg not downloaded yet
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_5e7bed9ee7936b92955313235cbfa81a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_5e7bed9ee7936b92955313235cbfa81a.jpg not downloaded yet
2026-03-28 11:05:21 [auto1.es] INFO: Found listing with ID: RK77233
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK77233%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.es] INFO: Scrape type for RK77233: 1
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_2794ca8b1f62ccab50f2fd7c9295ea0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_2794ca8b1f62ccab50f2fd7c9295ea0d.jpg not downloaded yet
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH53722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_d47fbdebe0925db618a3bc82890cd49c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_d47fbdebe0925db618a3bc82890cd49c.jpg not downloaded yet
2026-03-28 11:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_77a097956a97ea00331f00cde3d1fde7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_77a097956a97ea00331f00cde3d1fde7.jpg not downloaded yet
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_20195c93dc11bc4f27da6c040e3e7b74.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_20195c93dc11bc4f27da6c040e3e7b74.jpg not downloaded yet
2026-03-28 11:05:21 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-28 11:05:21 [auto1.es] INFO: Found listing with ID: VV48329
2026-03-28 11:05:21 [auto1.es] INFO: Found listing with ID: NR06421
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR06421%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.es] INFO: Scrape type for NR06421: 1
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_11e7ed3153c79bb71db23b87a688b1a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_11e7ed3153c79bb71db23b87a688b1a1.jpg not downloaded yet
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_f810cdbecca1be3c4c34ea7af2fcd210.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_f810cdbecca1be3c4c34ea7af2fcd210.jpg not downloaded yet
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_c5fcb3a5cccd2f3b6d20026944bb6f98.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c5fcb3a5cccd2f3b6d20026944bb6f98.jpg not downloaded yet
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_cec8693c62f8ef4c4d96da585950299d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_cec8693c62f8ef4c4d96da585950299d.jpg not downloaded yet
2026-03-28 11:05:21 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE40961%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.es] INFO: Scrape type for UE40961: 2
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-03-28 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab8644c-ef55-530e-a443-a11bb746b190 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cab8644c-ef55-530e-a443-a11bb746b190 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cab8644c-ef55-530e-a443-a11bb746b190, identifier: UE40961
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_8581bd7c224b3dc726c58d414c41feb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_8581bd7c224b3dc726c58d414c41feb8.jpg not downloaded yet
2026-03-28 11:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-03-28 11:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961 to the API
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:25Z',
 'fuel_type': 'diesel',
 'id': 'cab8644c-ef55-530e-a443-a11bb746b190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE40961',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 123537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE40961%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.es] INFO: Saving data for UE40961: {'auction_closing_time': 1774884385.0, 'created_time': 1774037190.521114, 'last_price_update_time': 1774695921.846495}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UE40961') HTTP/1.1" 204 0
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF33961> (referer: https://www.auto1.com/v1/car-details-view/GF33961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8311790>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_d4ee87c888fa82df34041c1f6458d00f.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_d4ee87c888fa82df34041c1f6458d00f.jpg saved to cache
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_1efae153a810c98bfce5ae8927c02ba5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1efae153a810c98bfce5ae8927c02ba5.jpg not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_e53513275bca7bf35b93e725a58886c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_e53513275bca7bf35b93e725a58886c1.jpg not downloaded yet
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: KH51643
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: VK88655
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK88655%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.es] INFO: Scrape type for VK88655: 1
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_9360f97df5934bd9ecd5aec4b178f786.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_818cf4547c969cee43fba95b898a0d8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_818cf4547c969cee43fba95b898a0d8f.jpg not downloaded yet
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY16878> (referer: https://www.auto1.com/v1/car-details-view/MY16878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_dff66c2774ace59d7bd6035325e6c6a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_dff66c2774ace59d7bd6035325e6c6a8.jpg not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_35877327b4f3cbd335811426c18d7289.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_35877327b4f3cbd335811426c18d7289.jpg not downloaded yet
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: LX19850
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX19850%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.es] INFO: Scrape type for LX19850: 1
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX69665> (referer: https://www.auto1.com/v1/car-details-view/FX69665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE66788> (referer: https://www.auto1.com/v1/car-details-view/PE66788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV64390> (referer: https://www.auto1.com/v1/car-details-view/NV64390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_c7c8ce039f112ca0ddb828f18a1c441c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c7c8ce039f112ca0ddb828f18a1c441c.jpg not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_9da0b4ec31e5048f79b654827bb5eb95.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_9da0b4ec31e5048f79b654827bb5eb95.jpg not downloaded yet
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: VY33491
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY33491%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.es] INFO: Scrape type for VY33491: 1
2026-03-28 11:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fddcaa9-9de1-56cd-abb8-38828817deda with identifier: GF33961
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fddcaa9-9de1-56cd-abb8-38828817deda with scrape type 1
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_7c92d71699702a33a0de49b62d5feddd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_7c92d71699702a33a0de49b62d5feddd.jpg not downloaded yet
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: WJ13987
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13987%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.es] INFO: Scrape type for WJ13987: 1
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_c236dc2ebe813877041f41adf4925a11.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_c236dc2ebe813877041f41adf4925a11.jpg not downloaded yet
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: CV66475
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: RU20773
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: DX72954
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: VA33750
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR52978%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.es] INFO: Scrape type for SR52978: 1
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_9886ac941c4afb0f30891e3c821708bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_9886ac941c4afb0f30891e3c821708bf.jpg not downloaded yet
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6303e50>
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_9360f97df5934bd9ecd5aec4b178f786.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_9360f97df5934bd9ecd5aec4b178f786.jpg saved to cache
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a with identifier: MY16878
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a with scrape type 1
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_511f3da759ce44dfcf1ff556b4dba160.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_511f3da759ce44dfcf1ff556b4dba160.jpg not downloaded yet
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_cec8693c62f8ef4c4d96da585950299d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31912ed9-d002-5f5f-b2f6-899f4a1c4683 with identifier: FX69665
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683 with scrape type 1
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_1ed8688f1cc45380214d3da309615ee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ed8688f1cc45380214d3da309615ee2.jpg not downloaded yet
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 with identifier: PE66788
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 with scrape type 1
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_39a0bb7b96df1045cfc731c73b192718.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_39a0bb7b96df1045cfc731c73b192718.jpg not downloaded yet
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de0fa3-f694-5341-9684-53b2d8cad80c with scrape type 1
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49de0fa3-f694-5341-9684-53b2d8cad80c
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_ca9c868035b32a6c4f62a9ec80ea9008.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ca9c868035b32a6c4f62a9ec80ea9008.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_77971bfaaa9427c280f4101ea39ae8c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_77971bfaaa9427c280f4101ea39ae8c6.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_9ef2c15d16bc445865252cc400b22cde.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_9ef2c15d16bc445865252cc400b22cde.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_a083d4de12a3a0effe580a3ef332f944.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_a083d4de12a3a0effe580a3ef332f944.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_7fcd93415559fc9c0a254a53a833ed56.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_7fcd93415559fc9c0a254a53a833ed56.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_11006ac1be08efc68ca34429b6e5ae70.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_11006ac1be08efc68ca34429b6e5ae70.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_ad5098c136fd27dd60d28dcbe70d4f13.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ad5098c136fd27dd60d28dcbe70d4f13.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_ec5f1c49f3bcd50f826d01bcf66c5a74.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ec5f1c49f3bcd50f826d01bcf66c5a74.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_40680a41872b8e38181a45c0399505e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_40680a41872b8e38181a45c0399505e7.jpg already downloaded
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc5%252Fb1c56f1f878b3e2cf71303ccd3d7e11f%252Fpa%252FNV64390_4924dded16a3781d644e05337ce06f89.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_4924dded16a3781d644e05337ce06f89.jpg already downloaded
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49de0fa3-f694-5341-9684-53b2d8cad80c, identifier: NV64390
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 01359fed-d4b0-5252-ba34-9ce842217476 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 01359fed-d4b0-5252-ba34-9ce842217476 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: ZK54179
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-28 11:05:22 [auto1.es] INFO: Found listing with ID: BK75900
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK75900%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.es] INFO: Scrape type for BK75900: 1
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_5fbfea48a2a8c854be157e0509e8bb55.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_5fbfea48a2a8c854be157e0509e8bb55.jpg not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_2ad8addbdd46ea8813d492264fcccb96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_2ad8addbdd46ea8813d492264fcccb96.jpg not downloaded yet
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-03-28 11:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390 to the API
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV64390>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:05Z',
 'fuel_type': 'diesel',
 'id': '49de0fa3-f694-5341-9684-53b2d8cad80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV64390',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 190301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ca9c868035b32a6c4f62a9ec80ea9008.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_77971bfaaa9427c280f4101ea39ae8c6.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_9ef2c15d16bc445865252cc400b22cde.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_a083d4de12a3a0effe580a3ef332f944.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_7fcd93415559fc9c0a254a53a833ed56.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_11006ac1be08efc68ca34429b6e5ae70.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ad5098c136fd27dd60d28dcbe70d4f13.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ec5f1c49f3bcd50f826d01bcf66c5a74.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_40680a41872b8e38181a45c0399505e7.jpg',
                'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_4924dded16a3781d644e05337ce06f89.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ca9c868035b32a6c4f62a9ec80ea9008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_77971bfaaa9427c280f4101ea39ae8c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_9ef2c15d16bc445865252cc400b22cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_a083d4de12a3a0effe580a3ef332f944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_7fcd93415559fc9c0a254a53a833ed56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_11006ac1be08efc68ca34429b6e5ae70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ad5098c136fd27dd60d28dcbe70d4f13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_ec5f1c49f3bcd50f826d01bcf66c5a74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_40680a41872b8e38181a45c0399505e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49de0fa3-f694-5341-9684-53b2d8cad80c/49de0fa3-f694-5341-9684-53b2d8cad80c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c5/b1c56f1f878b3e2cf71303ccd3d7e11f/pa/NV64390_4924dded16a3781d644e05337ce06f89.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV64390%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.es] INFO: Saving data for NV64390: {'created_time': 1774695923.238461, 'last_price_update_time': 1774695923.238475, 'auction_closing_time': 1774886045.0}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NV64390') HTTP/1.1" 204 0
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_fe44580f357eee041d25eeb722ecbe7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_fe44580f357eee041d25eeb722ecbe7b.jpg not downloaded yet
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_43450ef2169baea43e80d3773dd75501.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_43450ef2169baea43e80d3773dd75501.jpg not downloaded yet
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:23 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF82008%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.es] INFO: Scrape type for EF82008: 2
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f9c06d5-2665-5ae2-b405-a384413ede27 with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f9c06d5-2665-5ae2-b405-a384413ede27 with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f9c06d5-2665-5ae2-b405-a384413ede27, identifier: EF82008
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_c243d0e1cd3ee7a3035cefc896ca2efe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_c243d0e1cd3ee7a3035cefc896ca2efe.jpg not downloaded yet
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_695744900885bf1d701ad589ddc31105.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_695744900885bf1d701ad589ddc31105.jpg not downloaded yet
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c44d0>
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_cec8693c62f8ef4c4d96da585950299d.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_cec8693c62f8ef4c4d96da585950299d.jpg saved to cache
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_7c92d71699702a33a0de49b62d5feddd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008 to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'diesel',
 'id': '6f9c06d5-2665-5ae2-b405-a384413ede27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF82008',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 116703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF82008%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.es] INFO: Saving data for EF82008: {'auction_closing_time': 1774882995.0, 'created_time': 1773238784.4297, 'last_price_update_time': 1774695923.925049}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF82008') HTTP/1.1" 204 0
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_3941e01bfc5e18f9c7f46509c9efadab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_3941e01bfc5e18f9c7f46509c9efadab.jpg not downloaded yet
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_175a39c39748089c9714e82a794985df.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_175a39c39748089c9714e82a794985df.jpg not downloaded yet
2026-03-28 11:05:23 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX62344%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.es] INFO: Scrape type for TX62344: 1
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_2d8ed4e8df73cc469fbdc06e40fc0103.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_2d8ed4e8df73cc469fbdc06e40fc0103.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_a79eac2089a5fa172b6e4569d6be4044.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_a79eac2089a5fa172b6e4569d6be4044.jpg not downloaded yet
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 4fddcaa9-9de1-56cd-abb8-38828817deda due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_f405d4811ae89fdaa511b869bbf8be19.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_f405d4811ae89fdaa511b869bbf8be19.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_6f804d164e0014bb1819e266b0d3deec.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6f804d164e0014bb1819e266b0d3deec.jpg not downloaded yet
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: CY52892
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: RW90517
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: KK87704
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: AF53027
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: NX17648
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: RX17538
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX17538%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.es] INFO: Scrape type for RX17538: 1
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_bf7a01a1ec43cadbcefee5d3dc52eeb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_bf7a01a1ec43cadbcefee5d3dc52eeb0.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_61d8a386cae27b07d7f4cfe3be29b29b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_61d8a386cae27b07d7f4cfe3be29b29b.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_e2307b9164ae0d8ae932393659a94279.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e2307b9164ae0d8ae932393659a94279.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_6b92421bdab085930d6e9dc320457663.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6b92421bdab085930d6e9dc320457663.jpg not downloaded yet
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f71e5d90>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_7c92d71699702a33a0de49b62d5feddd.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_7c92d71699702a33a0de49b62d5feddd.jpg saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: PP42780
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP42780%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.es] INFO: Scrape type for PP42780: 1
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_5d9165dc78efd0a149960471085e10b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_5d9165dc78efd0a149960471085e10b7.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_13062f641e39937bc8fb85fb66e75a6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_13062f641e39937bc8fb85fb66e75a6c.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_43e309ca845d29ee3f88021e870fe20f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_43e309ca845d29ee3f88021e870fe20f.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg not downloaded yet
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_2ad8addbdd46ea8813d492264fcccb96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:24 [auto1.es] INFO: Found listing with ID: EK21860
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK21860%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.es] INFO: Scrape type for EK21860: 1
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_4139417218509d449f847e2da0ad4173.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_4139417218509d449f847e2da0ad4173.jpg not downloaded yet
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_c567338ef785d5fee0ffee0bfc873772.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_c567338ef785d5fee0ffee0bfc873772.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_145d78e316225d7fe616fa3369c8b2d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_145d78e316225d7fe616fa3369c8b2d2.jpg not downloaded yet
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK88655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_cd6ea4aa4b5acbbcca5de13581e54e1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_cd6ea4aa4b5acbbcca5de13581e54e1a.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_e7e569ca2ef6eb9a90d2d59f97a1e49a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e7e569ca2ef6eb9a90d2d59f97a1e49a.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_3ad6b3c8128700122c599fc43dca7179.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_3ad6b3c8128700122c599fc43dca7179.jpg not downloaded yet
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 4fddcaa9-9de1-56cd-abb8-38828817deda due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL17964> (referer: https://www.auto1.com/v1/car-details-view/KL17964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_1ff5c4b3c956becf7fe5d3e2c556cf70.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ff5c4b3c956becf7fe5d3e2c556cf70.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg not downloaded yet
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62e5ed0>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_2ad8addbdd46ea8813d492264fcccb96.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_2ad8addbdd46ea8813d492264fcccb96.jpg saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_583727f56afd4ac07957d916438558ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_583727f56afd4ac07957d916438558ee.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_eb3faa53d9c09d394dd2307f760cc248.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_eb3faa53d9c09d394dd2307f760cc248.jpg not downloaded yet
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 4fddcaa9-9de1-56cd-abb8-38828817deda due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c09308-8bdd-5f86-918e-82bfafdd1b89 with identifier: KL17964
2026-03-28 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c09308-8bdd-5f86-918e-82bfafdd1b89 with scrape type 1
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_fd667776f51b1f57802b196109a937a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_fd667776f51b1f57802b196109a937a1.jpg not downloaded yet
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_13062f641e39937bc8fb85fb66e75a6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_bb8582b4bbd73f90d51830d0317935d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_bb8582b4bbd73f90d51830d0317935d4.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_c096dbb5335c28c5982e9272cbe2417f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_c096dbb5335c28c5982e9272cbe2417f.jpg not downloaded yet
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_0b102485c03987353b06364f2e3c1dee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_0b102485c03987353b06364f2e3c1dee.jpg not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_7cc880e18ae9f20a5344d012611c3da0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_7cc880e18ae9f20a5344d012611c3da0.jpg not downloaded yet
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683 due to An error occurred while connecting: 104: Connection reset by peer.
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_8d37c98f9a202be670de728c45f4c0cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_8d37c98f9a202be670de728c45f4c0cf.jpg not downloaded yet
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e7e569ca2ef6eb9a90d2d59f97a1e49a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64245d0>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_13062f641e39937bc8fb85fb66e75a6c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_13062f641e39937bc8fb85fb66e75a6c.jpg saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ13987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f591cf50>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_e7e569ca2ef6eb9a90d2d59f97a1e49a.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e7e569ca2ef6eb9a90d2d59f97a1e49a.jpg saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_eb3faa53d9c09d394dd2307f760cc248.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH53722> (referer: https://www.auto1.com/v1/car-details-view/UH53722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f648f750>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_fd667776f51b1f57802b196109a937a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f595a8d0>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_eb3faa53d9c09d394dd2307f760cc248.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_eb3faa53d9c09d394dd2307f760cc248.jpg saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7148537-348c-5f8f-8f5f-512744a6567c with identifier: UH53722
2026-03-28 11:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7148537-348c-5f8f-8f5f-512744a6567c with scrape type 1
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_5742fc391ef92fa4f6557435bd89eb83.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_5742fc391ef92fa4f6557435bd89eb83.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_4e212ad99b56183c88502cee688a38ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4e212ad99b56183c88502cee688a38ce.jpg not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f835b2d0>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_fd667776f51b1f57802b196109a937a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_fd667776f51b1f57802b196109a937a1.jpg saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_f05140a9812a51f06554caff2eecf77f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_f05140a9812a51f06554caff2eecf77f.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_1cc4370d7e7a25d2cb0c0e9fef7a8183.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_1cc4370d7e7a25d2cb0c0e9fef7a8183.jpg not downloaded yet
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX19850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_4aa6ce515e8170bb4c0739549a344c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4aa6ce515e8170bb4c0739549a344c73.jpg not downloaded yet
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_8d37c98f9a202be670de728c45f4c0cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_cd2188f45bb8e5723a7b201fa237b531.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_cd2188f45bb8e5723a7b201fa237b531.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_a9d8163b3a735af2e191da301f9a9442.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a9d8163b3a735af2e191da301f9a9442.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_2eae3c52089d52881aee9ef61bc19011.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_2eae3c52089d52881aee9ef61bc19011.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_a399ee0565973677ca11a2aca045ca0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a399ee0565973677ca11a2aca045ca0b.jpg not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e5f10>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_8d37c98f9a202be670de728c45f4c0cf.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_8d37c98f9a202be670de728c45f4c0cf.jpg saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_7cc880e18ae9f20a5344d012611c3da0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f648c750>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_7cc880e18ae9f20a5344d012611c3da0.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_7cc880e18ae9f20a5344d012611c3da0.jpg saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_0b102485c03987353b06364f2e3c1dee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f651a590>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_0b102485c03987353b06364f2e3c1dee.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_0b102485c03987353b06364f2e3c1dee.jpg saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ13987> (referer: https://www.auto1.com/v1/car-details-view/WJ13987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_c096dbb5335c28c5982e9272cbe2417f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54be3468-1022-53d3-9b13-935462512f45 with identifier: WJ13987
2026-03-28 11:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54be3468-1022-53d3-9b13-935462512f45 with scrape type 1
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_81431c4435b034262282c39878f1a7ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_81431c4435b034262282c39878f1a7ea.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_8005ea6ebc4513cebe0b9896c10f7a3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_8005ea6ebc4513cebe0b9896c10f7a3c.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_4af9ad5a2c04583141034c05da7705a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_4af9ad5a2c04583141034c05da7705a1.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_9c53837a0a2224766aea87caf44e0a4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_9c53837a0a2224766aea87caf44e0a4d.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_bd1a7e9a550bac49f11bcb03b0a52e75.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_bd1a7e9a550bac49f11bcb03b0a52e75.jpg not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_3e8556e5ff566fe676d1bb63a7fe0e48.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_3e8556e5ff566fe676d1bb63a7fe0e48.jpg not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a5650>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_c096dbb5335c28c5982e9272cbe2417f.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_c096dbb5335c28c5982e9272cbe2417f.jpg saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_bb8582b4bbd73f90d51830d0317935d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c6990>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd8%252F8cd87a0ac29ef6da253b20a870459299%252Fpa%252FKL17964_bb8582b4bbd73f90d51830d0317935d4.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_bb8582b4bbd73f90d51830d0317935d4.jpg saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50c09308-8bdd-5f86-918e-82bfafdd1b89
2026-03-28 11:05:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50c09308-8bdd-5f86-918e-82bfafdd1b89, skipping ID generation
2026-03-28 11:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c09308-8bdd-5f86-918e-82bfafdd1b89 with scrape type 1
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50c09308-8bdd-5f86-918e-82bfafdd1b89 sending to next pipeline
2026-03-28 11:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50c09308-8bdd-5f86-918e-82bfafdd1b89, identifier: KL17964
2026-03-28 11:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50c09308-8bdd-5f86-918e-82bfafdd1b89 with identifier: KL17964
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 11:05:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50c09308-8bdd-5f86-918e-82bfafdd1b89 with identifier: KL17964
2026-03-28 11:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50c09308-8bdd-5f86-918e-82bfafdd1b89 with identifier: KL17964 to the API
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_bb8582b4bbd73f90d51830d0317935d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:09:57Z',
 'fuel_type': 'petrol',
 'id': '50c09308-8bdd-5f86-918e-82bfafdd1b89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL17964',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 216613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_fd667776f51b1f57802b196109a937a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_bb8582b4bbd73f90d51830d0317935d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_c096dbb5335c28c5982e9272cbe2417f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_0b102485c03987353b06364f2e3c1dee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_7cc880e18ae9f20a5344d012611c3da0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c09308-8bdd-5f86-918e-82bfafdd1b89/50c09308-8bdd-5f86-918e-82bfafdd1b89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/d8/8cd87a0ac29ef6da253b20a870459299/pa/KL17964_8d37c98f9a202be670de728c45f4c0cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.1 Magic',
 'transmission': 'manual',
 'trim': 'Magic',
 'year': 2004}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17964%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.es] INFO: Saving data for KL17964: {'created_time': 1774695926.849879, 'last_price_update_time': 1774695926.8499, 'auction_closing_time': 1774883397.0}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL17964') HTTP/1.1" 204 0
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_1cc4370d7e7a25d2cb0c0e9fef7a8183.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX19850> (referer: https://www.auto1.com/v1/car-details-view/LX19850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4aa6ce515e8170bb4c0739549a344c73.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f651a910>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_1cc4370d7e7a25d2cb0c0e9fef7a8183.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_1cc4370d7e7a25d2cb0c0e9fef7a8183.jpg saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 with identifier: LX19850
2026-03-28 11:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 with scrape type 1
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_d39b7d9f0c668e68c85b6e091fb63253.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_d39b7d9f0c668e68c85b6e091fb63253.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_714c8312ea4bf86e9801c4da756bf567.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_714c8312ea4bf86e9801c4da756bf567.jpg not downloaded yet
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5931790>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_4aa6ce515e8170bb4c0739549a344c73.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4aa6ce515e8170bb4c0739549a344c73.jpg saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_e942fdb1477c915a39b6e5ad45fea662.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_e942fdb1477c915a39b6e5ad45fea662.jpg not downloaded yet
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a399ee0565973677ca11a2aca045ca0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_704db20a8a4e9330f06dedfb9b673c10.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_704db20a8a4e9330f06dedfb9b673c10.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_4fc5494ae6ea4eaa686db838bfc7b4d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_4fc5494ae6ea4eaa686db838bfc7b4d6.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_2f13f9dd65135ff6329fcf97dac3a4f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_2f13f9dd65135ff6329fcf97dac3a4f3.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_993be96c59767fd58f28c7eb3f773e44.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_993be96c59767fd58f28c7eb3f773e44.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_a6565ccb6cddc1a079cad164343feb1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_a6565ccb6cddc1a079cad164343feb1c.jpg not downloaded yet
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_3ec62dda523757e0107ec591c0cfe732.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_3ec62dda523757e0107ec591c0cfe732.jpg not downloaded yet
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6463a50>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_a399ee0565973677ca11a2aca045ca0b.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a399ee0565973677ca11a2aca045ca0b.jpg saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_2eae3c52089d52881aee9ef61bc19011.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6582d90>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_2eae3c52089d52881aee9ef61bc19011.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_2eae3c52089d52881aee9ef61bc19011.jpg saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a9d8163b3a735af2e191da301f9a9442.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f648c310>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_a9d8163b3a735af2e191da301f9a9442.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a9d8163b3a735af2e191da301f9a9442.jpg saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_3e8556e5ff566fe676d1bb63a7fe0e48.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f592db50>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_3e8556e5ff566fe676d1bb63a7fe0e48.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_3e8556e5ff566fe676d1bb63a7fe0e48.jpg saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_bd1a7e9a550bac49f11bcb03b0a52e75.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645ec10>
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_bd1a7e9a550bac49f11bcb03b0a52e75.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_bd1a7e9a550bac49f11bcb03b0a52e75.jpg saved to cache
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_9c53837a0a2224766aea87caf44e0a4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6581010>
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_9c53837a0a2224766aea87caf44e0a4d.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_9c53837a0a2224766aea87caf44e0a4d.jpg saved to cache
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_4af9ad5a2c04583141034c05da7705a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645dd50>
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_4af9ad5a2c04583141034c05da7705a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_4af9ad5a2c04583141034c05da7705a1.jpg saved to cache
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_e942fdb1477c915a39b6e5ad45fea662.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a8afd0>
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_e942fdb1477c915a39b6e5ad45fea662.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_e942fdb1477c915a39b6e5ad45fea662.jpg saved to cache
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_3ec62dda523757e0107ec591c0cfe732.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_a6565ccb6cddc1a079cad164343feb1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645e010>
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_3ec62dda523757e0107ec591c0cfe732.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_3ec62dda523757e0107ec591c0cfe732.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630dd10>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_a6565ccb6cddc1a079cad164343feb1c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_a6565ccb6cddc1a079cad164343feb1c.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_993be96c59767fd58f28c7eb3f773e44.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645f350>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_993be96c59767fd58f28c7eb3f773e44.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_993be96c59767fd58f28c7eb3f773e44.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_2f13f9dd65135ff6329fcf97dac3a4f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e9910>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_2f13f9dd65135ff6329fcf97dac3a4f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_2f13f9dd65135ff6329fcf97dac3a4f3.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_4fc5494ae6ea4eaa686db838bfc7b4d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f595aa10>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_4fc5494ae6ea4eaa686db838bfc7b4d6.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_4fc5494ae6ea4eaa686db838bfc7b4d6.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_704db20a8a4e9330f06dedfb9b673c10.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6463390>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_704db20a8a4e9330f06dedfb9b673c10.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_704db20a8a4e9330f06dedfb9b673c10.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_714c8312ea4bf86e9801c4da756bf567.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63a3510>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_714c8312ea4bf86e9801c4da756bf567.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_714c8312ea4bf86e9801c4da756bf567.jpg saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_d39b7d9f0c668e68c85b6e091fb63253.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f592e590>
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_d39b7d9f0c668e68c85b6e091fb63253.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_d39b7d9f0c668e68c85b6e091fb63253.jpg saved to cache
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e8890>
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe9%252Fcce9e2b062d03e616eaa5c8a2d1eebcb%252Fpa%252FLX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg saved to cache
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4
2026-03-28 11:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4, skipping ID generation
2026-03-28 11:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 with scrape type 1
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 sending to next pipeline
2026-03-28 11:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4, identifier: LX19850
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 with identifier: LX19850
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 with identifier: LX19850
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4 with identifier: LX19850 to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:42Z',
 'fuel_type': 'diesel',
 'id': '3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX19850',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 79843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_97e8c36f16ca9bb6b6046c1ce8aceae7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_d39b7d9f0c668e68c85b6e091fb63253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_714c8312ea4bf86e9801c4da756bf567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_e942fdb1477c915a39b6e5ad45fea662.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_704db20a8a4e9330f06dedfb9b673c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_4fc5494ae6ea4eaa686db838bfc7b4d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_2f13f9dd65135ff6329fcf97dac3a4f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_993be96c59767fd58f28c7eb3f773e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_a6565ccb6cddc1a079cad164343feb1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4/3f9856bf-2a40-558f-84cc-1bd3ac1f0fd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e9/cce9e2b062d03e616eaa5c8a2d1eebcb/pa/LX19850_3ec62dda523757e0107ec591c0cfe732.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2007}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX19850%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.es] INFO: Saving data for LX19850: {'created_time': 1774695930.899358, 'last_price_update_time': 1774695930.89937, 'auction_closing_time': 1774884582.0}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LX19850') HTTP/1.1" 204 0
2026-03-28 11:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_8005ea6ebc4513cebe0b9896c10f7a3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_81431c4435b034262282c39878f1a7ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f592c050>
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_8005ea6ebc4513cebe0b9896c10f7a3c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_8005ea6ebc4513cebe0b9896c10f7a3c.jpg saved to cache
2026-03-28 11:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_cd2188f45bb8e5723a7b201fa237b531.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f595b350>
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F3b%252F893b5a9f6afaf4566f840aef41d5538d%252Fpa%252FWJ13987_81431c4435b034262282c39878f1a7ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_81431c4435b034262282c39878f1a7ea.jpg saved to cache
2026-03-28 11:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54be3468-1022-53d3-9b13-935462512f45
2026-03-28 11:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54be3468-1022-53d3-9b13-935462512f45, skipping ID generation
2026-03-28 11:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54be3468-1022-53d3-9b13-935462512f45 with scrape type 1
2026-03-28 11:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54be3468-1022-53d3-9b13-935462512f45 sending to next pipeline
2026-03-28 11:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 54be3468-1022-53d3-9b13-935462512f45, identifier: WJ13987
2026-03-28 11:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 54be3468-1022-53d3-9b13-935462512f45 with identifier: WJ13987
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 11:05:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 54be3468-1022-53d3-9b13-935462512f45 with identifier: WJ13987
2026-03-28 11:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 54be3468-1022-53d3-9b13-935462512f45 with identifier: WJ13987 to the API
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_81431c4435b034262282c39878f1a7ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:03:21Z',
 'fuel_type': 'diesel',
 'id': '54be3468-1022-53d3-9b13-935462512f45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ13987',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 195072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_81431c4435b034262282c39878f1a7ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_8005ea6ebc4513cebe0b9896c10f7a3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_4af9ad5a2c04583141034c05da7705a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_9c53837a0a2224766aea87caf44e0a4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_bd1a7e9a550bac49f11bcb03b0a52e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54be3468-1022-53d3-9b13-935462512f45/54be3468-1022-53d3-9b13-935462512f45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/3b/893b5a9f6afaf4566f840aef41d5538d/pa/WJ13987_3e8556e5ff566fe676d1bb63a7fe0e48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2006}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13987%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.es] INFO: Saving data for WJ13987: {'created_time': 1774695932.311845, 'last_price_update_time': 1774695932.311855, 'auction_closing_time': 1774883001.0}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ13987') HTTP/1.1" 204 0
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_f05140a9812a51f06554caff2eecf77f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM08693> (referer: https://www.auto1.com/v1/car-details-view/NM08693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59fa3d0>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_cd2188f45bb8e5723a7b201fa237b531.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_cd2188f45bb8e5723a7b201fa237b531.jpg saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4e212ad99b56183c88502cee688a38ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6460150>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_f05140a9812a51f06554caff2eecf77f.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_f05140a9812a51f06554caff2eecf77f.jpg saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4f0fb2-c967-589b-9b86-b2766650c9a0 with identifier: NM08693
2026-03-28 11:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4f0fb2-c967-589b-9b86-b2766650c9a0 with scrape type 1
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_82108889172dc9fe260da266ce2ef689.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_82108889172dc9fe260da266ce2ef689.jpg not downloaded yet
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_bcc4a7c7dd7f56a0a6f151c261462493.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_bcc4a7c7dd7f56a0a6f151c261462493.jpg not downloaded yet
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_eba484bd55c0f36c30c3bfb3781be1e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_eba484bd55c0f36c30c3bfb3781be1e7.jpg not downloaded yet
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6452110>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_4e212ad99b56183c88502cee688a38ce.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4e212ad99b56183c88502cee688a38ce.jpg saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_5742fc391ef92fa4f6557435bd89eb83.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_40a65642e7299f0c6626572fff8ecb63.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_40a65642e7299f0c6626572fff8ecb63.jpg not downloaded yet
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_643fd349c6132f5da9f6bfe4515dc7f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_643fd349c6132f5da9f6bfe4515dc7f3.jpg not downloaded yet
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_0bf2986be8365c2767e80509bc4b93b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_0bf2986be8365c2767e80509bc4b93b6.jpg not downloaded yet
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_76367c491d01029635734e4709831d57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_76367c491d01029635734e4709831d57.jpg not downloaded yet
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_7ba95748d7be1fd969b761f4a1a35378.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_7ba95748d7be1fd969b761f4a1a35378.jpg not downloaded yet
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_37ce376fd57c88c8710c16a6fe7d79d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_37ce376fd57c88c8710c16a6fe7d79d1.jpg not downloaded yet
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63feb90>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_5742fc391ef92fa4f6557435bd89eb83.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_5742fc391ef92fa4f6557435bd89eb83.jpg saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_a8389fb5d655d1a2ba6c6942d9585087.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_a8389fb5d655d1a2ba6c6942d9585087.jpg not downloaded yet
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_583727f56afd4ac07957d916438558ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64321d0>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb3%252F74b3fb0c9ad6ef8079e4dbaf1dda974f%252Fpa%252FUH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7148537-348c-5f8f-8f5f-512744a6567c
2026-03-28 11:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7148537-348c-5f8f-8f5f-512744a6567c, skipping ID generation
2026-03-28 11:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7148537-348c-5f8f-8f5f-512744a6567c with scrape type 1
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7148537-348c-5f8f-8f5f-512744a6567c sending to next pipeline
2026-03-28 11:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7148537-348c-5f8f-8f5f-512744a6567c, identifier: UH53722
2026-03-28 11:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7148537-348c-5f8f-8f5f-512744a6567c with identifier: UH53722
2026-03-28 11:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7148537-348c-5f8f-8f5f-512744a6567c with identifier: UH53722
2026-03-28 11:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7148537-348c-5f8f-8f5f-512744a6567c with identifier: UH53722 to the API
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:55:14Z',
 'fuel_type': 'petrol',
 'id': 'f7148537-348c-5f8f-8f5f-512744a6567c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH53722',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 169547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a5bbd0beb46c17e8ee35dad6d9bc4bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_5742fc391ef92fa4f6557435bd89eb83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4e212ad99b56183c88502cee688a38ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_f05140a9812a51f06554caff2eecf77f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_1cc4370d7e7a25d2cb0c0e9fef7a8183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_4aa6ce515e8170bb4c0739549a344c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_cd2188f45bb8e5723a7b201fa237b531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a9d8163b3a735af2e191da301f9a9442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_2eae3c52089d52881aee9ef61bc19011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7148537-348c-5f8f-8f5f-512744a6567c/f7148537-348c-5f8f-8f5f-512744a6567c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b3/74b3fb0c9ad6ef8079e4dbaf1dda974f/pa/UH53722_a399ee0565973677ca11a2aca045ca0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 2017}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH53722%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.es] INFO: Saving data for UH53722: {'created_time': 1774695933.308053, 'last_price_update_time': 1774695933.308062, 'auction_closing_time': 1774886114.0}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UH53722') HTTP/1.1" 204 0
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ff5c4b3c956becf7fe5d3e2c556cf70.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK88655> (referer: https://www.auto1.com/v1/car-details-view/VK88655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6451810>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_583727f56afd4ac07957d916438558ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_583727f56afd4ac07957d916438558ee.jpg saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6430350>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_1ff5c4b3c956becf7fe5d3e2c556cf70.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ff5c4b3c956becf7fe5d3e2c556cf70.jpg saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_cd6ea4aa4b5acbbcca5de13581e54e1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88051967-fd29-5f6a-9359-4038c3e3ae21 with identifier: VK88655
2026-03-28 11:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88051967-fd29-5f6a-9359-4038c3e3ae21 with scrape type 1
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg not downloaded yet
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_f18cf145fbbc6f28dc73d69507d50a54.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_f18cf145fbbc6f28dc73d69507d50a54.jpg not downloaded yet
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_b1f73ccdfc554ef53ac74fd211b738f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_b1f73ccdfc554ef53ac74fd211b738f2.jpg not downloaded yet
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_da9bf25173e0aec4b03d09b6494f644c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da9bf25173e0aec4b03d09b6494f644c.jpg not downloaded yet
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_4139417218509d449f847e2da0ad4173.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK21860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_6afc078512e5672d3e3a204bf8010870.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_6afc078512e5672d3e3a204bf8010870.jpg not downloaded yet
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_c56007a809b06da89e23701f035c0952.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_c56007a809b06da89e23701f035c0952.jpg not downloaded yet
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ba7d0>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_cd6ea4aa4b5acbbcca5de13581e54e1a.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_cd6ea4aa4b5acbbcca5de13581e54e1a.jpg saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_eba484bd55c0f36c30c3bfb3781be1e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630d090>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_4139417218509d449f847e2da0ad4173.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_4139417218509d449f847e2da0ad4173.jpg saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62e5450>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_eba484bd55c0f36c30c3bfb3781be1e7.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_eba484bd55c0f36c30c3bfb3781be1e7.jpg saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_76367c491d01029635734e4709831d57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6303390>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_76367c491d01029635734e4709831d57.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_76367c491d01029635734e4709831d57.jpg saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_a8389fb5d655d1a2ba6c6942d9585087.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e9c10>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_a8389fb5d655d1a2ba6c6942d9585087.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_a8389fb5d655d1a2ba6c6942d9585087.jpg saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_37ce376fd57c88c8710c16a6fe7d79d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f648e290>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_37ce376fd57c88c8710c16a6fe7d79d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_37ce376fd57c88c8710c16a6fe7d79d1.jpg saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_7ba95748d7be1fd969b761f4a1a35378.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM37259> (referer: https://www.auto1.com/v1/car-details-view/XM37259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6431410>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_7ba95748d7be1fd969b761f4a1a35378.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_7ba95748d7be1fd969b761f4a1a35378.jpg saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ea6d6f-7871-571b-81fc-21389e467932 with identifier: XM37259
2026-03-28 11:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ea6d6f-7871-571b-81fc-21389e467932 with scrape type 1
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg not downloaded yet
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_5ad42275166d298f93082bd06de628bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_5ad42275166d298f93082bd06de628bd.jpg not downloaded yet
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_ca7d90f9b518b38914f688c70d517a73.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ca7d90f9b518b38914f688c70d517a73.jpg not downloaded yet
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_3f018e1372e786b50cc2d38f8caa3888.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_3f018e1372e786b50cc2d38f8caa3888.jpg not downloaded yet
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_10e39d81d80bc5a125fa1a3aeb81fa5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_10e39d81d80bc5a125fa1a3aeb81fa5b.jpg not downloaded yet
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_0bf2986be8365c2767e80509bc4b93b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_83e53aa5dae0dc78c4b240488aeaec42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_83e53aa5dae0dc78c4b240488aeaec42.jpg not downloaded yet
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630f110>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_0bf2986be8365c2767e80509bc4b93b6.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_0bf2986be8365c2767e80509bc4b93b6.jpg saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK21860> (referer: https://www.auto1.com/v1/car-details-view/EK21860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_b1f73ccdfc554ef53ac74fd211b738f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a6d24c-ede3-5320-bcc5-a457e181baab with identifier: EK21860
2026-03-28 11:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a6d24c-ede3-5320-bcc5-a457e181baab with scrape type 1
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_f54ca2ad3a84411cfe3a4d38f26ed709.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_f54ca2ad3a84411cfe3a4d38f26ed709.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_94b6bf139bbbea71c6259e75610ae1ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_94b6bf139bbbea71c6259e75610ae1ff.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_86953670243b9061a984311ca5e7fe9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_86953670243b9061a984311ca5e7fe9c.jpg not downloaded yet
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5932b50>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_b1f73ccdfc554ef53ac74fd211b738f2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_b1f73ccdfc554ef53ac74fd211b738f2.jpg saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_28978dad3ed3b4f3283aa8cf78339d72.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_28978dad3ed3b4f3283aa8cf78339d72.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_c076152dd89268eaf6f60386da3521cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c076152dd89268eaf6f60386da3521cc.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_45dde9bed0d6219513cfdac722a74200.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_45dde9bed0d6219513cfdac722a74200.jpg not downloaded yet
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da9bf25173e0aec4b03d09b6494f644c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_c6f8abbdabcb276dfa4d5617191ed59d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c6f8abbdabcb276dfa4d5617191ed59d.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_9d37d83fa59738420fe365be478c80ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_9d37d83fa59738420fe365be478c80ee.jpg not downloaded yet
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_a075165f8c90d16e6503804f99ebe95e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_a075165f8c90d16e6503804f99ebe95e.jpg not downloaded yet
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645b110>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_da9bf25173e0aec4b03d09b6494f644c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da9bf25173e0aec4b03d09b6494f644c.jpg saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_c56007a809b06da89e23701f035c0952.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6301d90>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_c56007a809b06da89e23701f035c0952.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_c56007a809b06da89e23701f035c0952.jpg saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_6afc078512e5672d3e3a204bf8010870.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645d010>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_6afc078512e5672d3e3a204bf8010870.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_6afc078512e5672d3e3a204bf8010870.jpg saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_f18cf145fbbc6f28dc73d69507d50a54.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6300a50>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_f18cf145fbbc6f28dc73d69507d50a54.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_f18cf145fbbc6f28dc73d69507d50a54.jpg saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63b8150>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc8%252Fb3c87aafccee3dc157d74f89b3fbfb1e%252Fpa%252FVK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88051967-fd29-5f6a-9359-4038c3e3ae21
2026-03-28 11:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88051967-fd29-5f6a-9359-4038c3e3ae21, skipping ID generation
2026-03-28 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88051967-fd29-5f6a-9359-4038c3e3ae21 with scrape type 1
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88051967-fd29-5f6a-9359-4038c3e3ae21 sending to next pipeline
2026-03-28 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88051967-fd29-5f6a-9359-4038c3e3ae21, identifier: VK88655
2026-03-28 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88051967-fd29-5f6a-9359-4038c3e3ae21 with identifier: VK88655
2026-03-28 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88051967-fd29-5f6a-9359-4038c3e3ae21 with identifier: VK88655
2026-03-28 11:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88051967-fd29-5f6a-9359-4038c3e3ae21 with identifier: VK88655 to the API
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:37:48Z',
 'fuel_type': 'diesel',
 'id': '88051967-fd29-5f6a-9359-4038c3e3ae21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK88655',
 'listing': 'auction',
 'location': 'ES, Jaén',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 257755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da0eeadb0419d891c9c3b90b4faf3a43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_f18cf145fbbc6f28dc73d69507d50a54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_b1f73ccdfc554ef53ac74fd211b738f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_da9bf25173e0aec4b03d09b6494f644c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_6afc078512e5672d3e3a204bf8010870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88051967-fd29-5f6a-9359-4038c3e3ae21/88051967-fd29-5f6a-9359-4038c3e3ae21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c8/b3c87aafccee3dc157d74f89b3fbfb1e/pa/VK88655_c56007a809b06da89e23701f035c0952.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK88655%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.es] INFO: Saving data for VK88655: {'created_time': 1774695936.822416, 'last_price_update_time': 1774695936.822427, 'auction_closing_time': 1774885068.0}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK88655') HTTP/1.1" 204 0
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_643fd349c6132f5da9f6bfe4515dc7f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6334450>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_643fd349c6132f5da9f6bfe4515dc7f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_643fd349c6132f5da9f6bfe4515dc7f3.jpg saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_10e39d81d80bc5a125fa1a3aeb81fa5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6433950>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_10e39d81d80bc5a125fa1a3aeb81fa5b.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_10e39d81d80bc5a125fa1a3aeb81fa5b.jpg saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_83e53aa5dae0dc78c4b240488aeaec42.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645e350>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_83e53aa5dae0dc78c4b240488aeaec42.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_83e53aa5dae0dc78c4b240488aeaec42.jpg saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_3f018e1372e786b50cc2d38f8caa3888.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6431c10>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_3f018e1372e786b50cc2d38f8caa3888.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_3f018e1372e786b50cc2d38f8caa3888.jpg saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_45dde9bed0d6219513cfdac722a74200.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_a075165f8c90d16e6503804f99ebe95e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a89e90>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_45dde9bed0d6219513cfdac722a74200.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_45dde9bed0d6219513cfdac722a74200.jpg saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_9d37d83fa59738420fe365be478c80ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f3390>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_a075165f8c90d16e6503804f99ebe95e.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_a075165f8c90d16e6503804f99ebe95e.jpg saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c6f8abbdabcb276dfa4d5617191ed59d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6418550>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_9d37d83fa59738420fe365be478c80ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_9d37d83fa59738420fe365be478c80ee.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6430d90>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_c6f8abbdabcb276dfa4d5617191ed59d.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c6f8abbdabcb276dfa4d5617191ed59d.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c076152dd89268eaf6f60386da3521cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63fe790>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_c076152dd89268eaf6f60386da3521cc.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c076152dd89268eaf6f60386da3521cc.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_28978dad3ed3b4f3283aa8cf78339d72.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_86953670243b9061a984311ca5e7fe9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6581b90>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_28978dad3ed3b4f3283aa8cf78339d72.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_28978dad3ed3b4f3283aa8cf78339d72.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_94b6bf139bbbea71c6259e75610ae1ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64607d0>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_86953670243b9061a984311ca5e7fe9c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_86953670243b9061a984311ca5e7fe9c.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_f54ca2ad3a84411cfe3a4d38f26ed709.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f591dad0>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_94b6bf139bbbea71c6259e75610ae1ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_94b6bf139bbbea71c6259e75610ae1ff.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6336c50>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_f54ca2ad3a84411cfe3a4d38f26ed709.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_f54ca2ad3a84411cfe3a4d38f26ed709.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f592d890>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fee%252F88ee1b8fb6f90d40f56e2d70c86a349b%252Fpa%252FEK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57a6d24c-ede3-5320-bcc5-a457e181baab
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57a6d24c-ede3-5320-bcc5-a457e181baab, skipping ID generation
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a6d24c-ede3-5320-bcc5-a457e181baab with scrape type 1
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57a6d24c-ede3-5320-bcc5-a457e181baab sending to next pipeline
2026-03-28 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 57a6d24c-ede3-5320-bcc5-a457e181baab, identifier: EK21860
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 57a6d24c-ede3-5320-bcc5-a457e181baab with identifier: EK21860
2026-03-28 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 57a6d24c-ede3-5320-bcc5-a457e181baab with identifier: EK21860
2026-03-28 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 57a6d24c-ede3-5320-bcc5-a457e181baab with identifier: EK21860 to the API
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:46:04Z',
 'fuel_type': 'petrol',
 'id': '57a6d24c-ede3-5320-bcc5-a457e181baab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK21860',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 153921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_46cbd662b4df7dca3b956af4aaf6dca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_f54ca2ad3a84411cfe3a4d38f26ed709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_94b6bf139bbbea71c6259e75610ae1ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_86953670243b9061a984311ca5e7fe9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_28978dad3ed3b4f3283aa8cf78339d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c076152dd89268eaf6f60386da3521cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_45dde9bed0d6219513cfdac722a74200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_c6f8abbdabcb276dfa4d5617191ed59d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_9d37d83fa59738420fe365be478c80ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57a6d24c-ede3-5320-bcc5-a457e181baab/57a6d24c-ede3-5320-bcc5-a457e181baab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ee/88ee1b8fb6f90d40f56e2d70c86a349b/pa/EK21860_a075165f8c90d16e6503804f99ebe95e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK21860%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.es] INFO: Saving data for EK21860: {'created_time': 1774695939.209137, 'last_price_update_time': 1774695939.209147, 'auction_closing_time': 1774885564.0}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EK21860') HTTP/1.1" 204 0
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ca7d90f9b518b38914f688c70d517a73.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f591cfd0>
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_ca7d90f9b518b38914f688c70d517a73.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ca7d90f9b518b38914f688c70d517a73.jpg saved to cache
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_5ad42275166d298f93082bd06de628bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63b9890>
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_5ad42275166d298f93082bd06de628bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_5ad42275166d298f93082bd06de628bd.jpg saved to cache
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_40a65642e7299f0c6626572fff8ecb63.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63fc710>
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2e%252F8f2ed1fb44f00690bd1593eaa5156e84%252Fpa%252FXM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg saved to cache
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73ea6d6f-7871-571b-81fc-21389e467932
2026-03-28 11:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73ea6d6f-7871-571b-81fc-21389e467932, skipping ID generation
2026-03-28 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ea6d6f-7871-571b-81fc-21389e467932 with scrape type 1
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73ea6d6f-7871-571b-81fc-21389e467932 sending to next pipeline
2026-03-28 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73ea6d6f-7871-571b-81fc-21389e467932, identifier: XM37259
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73ea6d6f-7871-571b-81fc-21389e467932 with identifier: XM37259
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73ea6d6f-7871-571b-81fc-21389e467932 with identifier: XM37259
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73ea6d6f-7871-571b-81fc-21389e467932 with identifier: XM37259 to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:52Z',
 'fuel_type': 'diesel',
 'id': '73ea6d6f-7871-571b-81fc-21389e467932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM37259',
 'listing': 'auction',
 'location': 'ES, Santa Ana',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 236202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ec80ca41b4695b36aefa18cfc1ce6350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_5ad42275166d298f93082bd06de628bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_ca7d90f9b518b38914f688c70d517a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_3f018e1372e786b50cc2d38f8caa3888.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_10e39d81d80bc5a125fa1a3aeb81fa5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ea6d6f-7871-571b-81fc-21389e467932/73ea6d6f-7871-571b-81fc-21389e467932_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2e/8f2ed1fb44f00690bd1593eaa5156e84/pa/XM37259_83e53aa5dae0dc78c4b240488aeaec42.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2007}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM37259%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.es] INFO: Saving data for XM37259: {'created_time': 1774695941.555004, 'last_price_update_time': 1774695941.555014, 'auction_closing_time': 1774886152.0}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XM37259') HTTP/1.1" 204 0
2026-03-28 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_bcc4a7c7dd7f56a0a6f151c261462493.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP42780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6529b90>
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_40a65642e7299f0c6626572fff8ecb63.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_40a65642e7299f0c6626572fff8ecb63.jpg saved to cache
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_82108889172dc9fe260da266ce2ef689.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6419010>
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_bcc4a7c7dd7f56a0a6f151c261462493.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_bcc4a7c7dd7f56a0a6f151c261462493.jpg saved to cache
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645f450>
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F7c%252F4f7cf7d882cb98c42d79e0cce54c2cc4%252Fpa%252FNM08693_82108889172dc9fe260da266ce2ef689.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_82108889172dc9fe260da266ce2ef689.jpg saved to cache
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad4f0fb2-c967-589b-9b86-b2766650c9a0
2026-03-28 11:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad4f0fb2-c967-589b-9b86-b2766650c9a0, skipping ID generation
2026-03-28 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4f0fb2-c967-589b-9b86-b2766650c9a0 with scrape type 1
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad4f0fb2-c967-589b-9b86-b2766650c9a0 sending to next pipeline
2026-03-28 11:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad4f0fb2-c967-589b-9b86-b2766650c9a0, identifier: NM08693
2026-03-28 11:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad4f0fb2-c967-589b-9b86-b2766650c9a0 with identifier: NM08693
2026-03-28 11:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad4f0fb2-c967-589b-9b86-b2766650c9a0 with identifier: NM08693
2026-03-28 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad4f0fb2-c967-589b-9b86-b2766650c9a0 with identifier: NM08693 to the API
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_82108889172dc9fe260da266ce2ef689.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:09Z',
 'fuel_type': 'petrol',
 'id': 'ad4f0fb2-c967-589b-9b86-b2766650c9a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM08693',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 79836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_82108889172dc9fe260da266ce2ef689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_bcc4a7c7dd7f56a0a6f151c261462493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_eba484bd55c0f36c30c3bfb3781be1e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_40a65642e7299f0c6626572fff8ecb63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_643fd349c6132f5da9f6bfe4515dc7f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_0bf2986be8365c2767e80509bc4b93b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_76367c491d01029635734e4709831d57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_7ba95748d7be1fd969b761f4a1a35378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_37ce376fd57c88c8710c16a6fe7d79d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4f0fb2-c967-589b-9b86-b2766650c9a0/ad4f0fb2-c967-589b-9b86-b2766650c9a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/7c/4f7cf7d882cb98c42d79e0cce54c2cc4/pa/NM08693_a8389fb5d655d1a2ba6c6942d9585087.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2022}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM08693%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.es] INFO: Saving data for NM08693: {'created_time': 1774695942.302077, 'last_price_update_time': 1774695942.302092, 'auction_closing_time': 1774884969.0}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM08693') HTTP/1.1" 204 0
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_43e309ca845d29ee3f88021e870fe20f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6300210>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64310d0>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_43e309ca845d29ee3f88021e870fe20f.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_43e309ca845d29ee3f88021e870fe20f.jpg saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6b92421bdab085930d6e9dc320457663.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645fe10>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_6b92421bdab085930d6e9dc320457663.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6b92421bdab085930d6e9dc320457663.jpg saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e2307b9164ae0d8ae932393659a94279.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX17538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645cc10>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_e2307b9164ae0d8ae932393659a94279.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e2307b9164ae0d8ae932393659a94279.jpg saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_61d8a386cae27b07d7f4cfe3be29b29b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_bf7a01a1ec43cadbcefee5d3dc52eeb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63015d0>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_61d8a386cae27b07d7f4cfe3be29b29b.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_61d8a386cae27b07d7f4cfe3be29b29b.jpg saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a89ad0>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_bf7a01a1ec43cadbcefee5d3dc52eeb0.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_bf7a01a1ec43cadbcefee5d3dc52eeb0.jpg saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_f405d4811ae89fdaa511b869bbf8be19.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f641b210>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_f405d4811ae89fdaa511b869bbf8be19.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_f405d4811ae89fdaa511b869bbf8be19.jpg saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP42780> (referer: https://www.auto1.com/v1/car-details-view/PP42780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_a79eac2089a5fa172b6e4569d6be4044.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_2d8ed4e8df73cc469fbdc06e40fc0103.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c719b6b-4e2b-5d15-a59c-237ba9ec090f with identifier: PP42780
2026-03-28 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f with scrape type 1
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg not downloaded yet
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_22c62dc2781608eda46df8cfa0207f9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_22c62dc2781608eda46df8cfa0207f9a.jpg not downloaded yet
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_fa3f1215f6a8d70a2c5bf09d1f2c87d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_fa3f1215f6a8d70a2c5bf09d1f2c87d2.jpg not downloaded yet
2026-03-28 11:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_175a39c39748089c9714e82a794985df.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_de47fb3fbf7edb1298cdd8b054b3321e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_de47fb3fbf7edb1298cdd8b054b3321e.jpg not downloaded yet
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63bb190>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff0%252Fb9f0d03447795f49e58c3fc7b461d744%252Fpa%252FMY16878_a79eac2089a5fa172b6e4569d6be4044.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_a79eac2089a5fa172b6e4569d6be4044.jpg saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a, skipping ID generation
2026-03-28 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a with scrape type 1
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a sending to next pipeline
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a, identifier: MY16878
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_736134ae73ada5dbdae8f86421c1424f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_736134ae73ada5dbdae8f86421c1424f.jpg not downloaded yet
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a with identifier: MY16878
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a with identifier: MY16878
2026-03-28 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a with identifier: MY16878 to the API
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_a79eac2089a5fa172b6e4569d6be4044.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:40Z',
 'fuel_type': 'diesel',
 'id': 'df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY16878',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 243852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_2ad8addbdd46ea8813d492264fcccb96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_a79eac2089a5fa172b6e4569d6be4044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_61d8a386cae27b07d7f4cfe3be29b29b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a/df5b91f9-3743-5ae9-9b0a-4e4edceb2b8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f0/b9f0d03447795f49e58c3fc7b461d744/pa/MY16878_13062f641e39937bc8fb85fb66e75a6c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.9 CDTI Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2006}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY16878%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.es] INFO: Saving data for MY16878: {'created_time': 1774695944.092646, 'last_price_update_time': 1774695944.092656, 'auction_closing_time': 1774884940.0}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY16878') HTTP/1.1" 204 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_8802017ce5ddce180ec7d507b9d926fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_8802017ce5ddce180ec7d507b9d926fd.jpg not downloaded yet
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_3941e01bfc5e18f9c7f46509c9efadab.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX17538> (referer: https://www.auto1.com/v1/car-details-view/RX17538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62af3d0>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_2d8ed4e8df73cc469fbdc06e40fc0103.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_2d8ed4e8df73cc469fbdc06e40fc0103.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59fa7d0>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_175a39c39748089c9714e82a794985df.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_175a39c39748089c9714e82a794985df.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_ba443371d1ab096ffd2218426ad86c22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_ba443371d1ab096ffd2218426ad86c22.jpg not downloaded yet
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_489b28182dfdbd9b5b26499c23cc8612.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_489b28182dfdbd9b5b26499c23cc8612.jpg not downloaded yet
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_646a7de0c503a78520f16a9e443932ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_646a7de0c503a78520f16a9e443932ea.jpg not downloaded yet
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_c7bb5e4a9feccbe89cb1250222e2d355.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_c7bb5e4a9feccbe89cb1250222e2d355.jpg not downloaded yet
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_43450ef2169baea43e80d3773dd75501.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f593b390>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_3941e01bfc5e18f9c7f46509c9efadab.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_3941e01bfc5e18f9c7f46509c9efadab.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293b36e4-e44b-5c89-88ac-5c92e5782e49 with identifier: RX17538
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293b36e4-e44b-5c89-88ac-5c92e5782e49 with scrape type 1
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 293b36e4-e44b-5c89-88ac-5c92e5782e49
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg not downloaded yet
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_8804070813260fcf5946a0742f9e7eef.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_8804070813260fcf5946a0742f9e7eef.jpg not downloaded yet
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_2ebbd525e914b080a356538f1f6df8ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_2ebbd525e914b080a356538f1f6df8ea.jpg not downloaded yet
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_07315d018d95444fb7ca02604803a76c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_07315d018d95444fb7ca02604803a76c.jpg not downloaded yet
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5959710>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_43450ef2169baea43e80d3773dd75501.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_43450ef2169baea43e80d3773dd75501.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_fe44580f357eee041d25eeb722ecbe7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_5fbfea48a2a8c854be157e0509e8bb55.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59f90d0>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_fe44580f357eee041d25eeb722ecbe7b.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_fe44580f357eee041d25eeb722ecbe7b.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_39a0bb7b96df1045cfc731c73b192718.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6335a10>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_5fbfea48a2a8c854be157e0509e8bb55.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_5fbfea48a2a8c854be157e0509e8bb55.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_fa3f1215f6a8d70a2c5bf09d1f2c87d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59fa990>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fbd%252F71bdd31d2894242668fc7074e86d49fc%252Fpa%252FPE66788_39a0bb7b96df1045cfc731c73b192718.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_39a0bb7b96df1045cfc731c73b192718.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a8afd0>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_fa3f1215f6a8d70a2c5bf09d1f2c87d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_fa3f1215f6a8d70a2c5bf09d1f2c87d2.jpg saved to cache
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK75900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_736134ae73ada5dbdae8f86421c1424f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_8802017ce5ddce180ec7d507b9d926fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f647cc10>
2026-03-28 11:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_736134ae73ada5dbdae8f86421c1424f.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_736134ae73ada5dbdae8f86421c1424f.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_646a7de0c503a78520f16a9e443932ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59a1390>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_8802017ce5ddce180ec7d507b9d926fd.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_8802017ce5ddce180ec7d507b9d926fd.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_07315d018d95444fb7ca02604803a76c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59438d0>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_646a7de0c503a78520f16a9e443932ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_646a7de0c503a78520f16a9e443932ea.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_2ebbd525e914b080a356538f1f6df8ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82f7ed0>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_07315d018d95444fb7ca02604803a76c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_07315d018d95444fb7ca02604803a76c.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 293b36e4-e44b-5c89-88ac-5c92e5782e49
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_8804070813260fcf5946a0742f9e7eef.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59ac750>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_2ebbd525e914b080a356538f1f6df8ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_2ebbd525e914b080a356538f1f6df8ea.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 293b36e4-e44b-5c89-88ac-5c92e5782e49
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5959c50>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_8804070813260fcf5946a0742f9e7eef.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_8804070813260fcf5946a0742f9e7eef.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 293b36e4-e44b-5c89-88ac-5c92e5782e49
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_c7bb5e4a9feccbe89cb1250222e2d355.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59aa750>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0a%252Fb20ac560366fa91d5a1a91e9e0e31370%252Fpa%252FRX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 293b36e4-e44b-5c89-88ac-5c92e5782e49
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 293b36e4-e44b-5c89-88ac-5c92e5782e49, skipping ID generation
2026-03-28 11:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293b36e4-e44b-5c89-88ac-5c92e5782e49 with scrape type 1
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 293b36e4-e44b-5c89-88ac-5c92e5782e49 sending to next pipeline
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 293b36e4-e44b-5c89-88ac-5c92e5782e49, identifier: RX17538
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 293b36e4-e44b-5c89-88ac-5c92e5782e49 with identifier: RX17538
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 293b36e4-e44b-5c89-88ac-5c92e5782e49 with identifier: RX17538
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 293b36e4-e44b-5c89-88ac-5c92e5782e49 with identifier: RX17538 to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:46:17Z',
 'fuel_type': 'diesel',
 'id': '293b36e4-e44b-5c89-88ac-5c92e5782e49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX17538',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 267591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_5f38af06641a8c9f0abad156cfe8d49c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_8804070813260fcf5946a0742f9e7eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_2ebbd525e914b080a356538f1f6df8ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293b36e4-e44b-5c89-88ac-5c92e5782e49/293b36e4-e44b-5c89-88ac-5c92e5782e49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/0a/b20ac560366fa91d5a1a91e9e0e31370/pa/RX17538_07315d018d95444fb7ca02604803a76c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Style 4x4',
 'transmission': 'manual',
 'trim': 'Style 4x4',
 'year': 2011}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX17538%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.es] INFO: Saving data for RX17538: {'created_time': 1774695946.021468, 'last_price_update_time': 1774695946.021478, 'auction_closing_time': 1774885577.0}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX17538') HTTP/1.1" 204 0
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_489b28182dfdbd9b5b26499c23cc8612.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK75900> (referer: https://www.auto1.com/v1/car-details-view/BK75900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6337510>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_c7bb5e4a9feccbe89cb1250222e2d355.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_c7bb5e4a9feccbe89cb1250222e2d355.jpg saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5942350>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_489b28182dfdbd9b5b26499c23cc8612.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_489b28182dfdbd9b5b26499c23cc8612.jpg saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_ba443371d1ab096ffd2218426ad86c22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b293699-8245-5747-8a11-0039aecf6f8b with identifier: BK75900
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b293699-8245-5747-8a11-0039aecf6f8b with scrape type 1
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_f48b7175fea1b2938ae7402cabecce49.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_f48b7175fea1b2938ae7402cabecce49.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_29531caf18dba99679d359b6455bec7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_29531caf18dba99679d359b6455bec7c.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_5eb331bc2e4f1310c2ba664c9e6d22ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eb331bc2e4f1310c2ba664c9e6d22ad.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_9b196c118cfc634f72c1181e174837ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_9b196c118cfc634f72c1181e174837ee.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_e5ef921aa19e2253aaa1302c0ffd4c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_e5ef921aa19e2253aaa1302c0ffd4c86.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_414dc1f3c2e92dcbd0f611c48f6c579c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_414dc1f3c2e92dcbd0f611c48f6c579c.jpg not downloaded yet
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f593be10>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_ba443371d1ab096ffd2218426ad86c22.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_ba443371d1ab096ffd2218426ad86c22.jpg saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_dd18655d29a6589d4752c999aa047d00.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_dd18655d29a6589d4752c999aa047d00.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_acdc66b0d25fad47b713d704eb030577.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_acdc66b0d25fad47b713d704eb030577.jpg not downloaded yet
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_5eda71ac3045624a7deec62c4c5d5a38.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eda71ac3045624a7deec62c4c5d5a38.jpg not downloaded yet
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_de47fb3fbf7edb1298cdd8b054b3321e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_22c62dc2781608eda46df8cfa0207f9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59b6b90>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_de47fb3fbf7edb1298cdd8b054b3321e.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_de47fb3fbf7edb1298cdd8b054b3321e.jpg saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX62344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6462010>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_22c62dc2781608eda46df8cfa0207f9a.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_22c62dc2781608eda46df8cfa0207f9a.jpg saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ed8688f1cc45380214d3da309615ee2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82a9790>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3e%252F083ed01f96e93435c7f6a33d5a902e8a%252Fpa%252FPP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c719b6b-4e2b-5d15-a59c-237ba9ec090f, skipping ID generation
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f with scrape type 1
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c719b6b-4e2b-5d15-a59c-237ba9ec090f sending to next pipeline
2026-03-28 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c719b6b-4e2b-5d15-a59c-237ba9ec090f, identifier: PP42780
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c719b6b-4e2b-5d15-a59c-237ba9ec090f with identifier: PP42780
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c719b6b-4e2b-5d15-a59c-237ba9ec090f with identifier: PP42780
2026-03-28 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c719b6b-4e2b-5d15-a59c-237ba9ec090f with identifier: PP42780 to the API
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:09Z',
 'fuel_type': 'petrol',
 'id': '8c719b6b-4e2b-5d15-a59c-237ba9ec090f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP42780',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 135184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_0931e35f04bcdef42c7ba25a49feaa37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_22c62dc2781608eda46df8cfa0207f9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_fa3f1215f6a8d70a2c5bf09d1f2c87d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_de47fb3fbf7edb1298cdd8b054b3321e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_736134ae73ada5dbdae8f86421c1424f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_8802017ce5ddce180ec7d507b9d926fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_ba443371d1ab096ffd2218426ad86c22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_489b28182dfdbd9b5b26499c23cc8612.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_646a7de0c503a78520f16a9e443932ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c719b6b-4e2b-5d15-a59c-237ba9ec090f/8c719b6b-4e2b-5d15-a59c-237ba9ec090f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3e/083ed01f96e93435c7f6a33d5a902e8a/pa/PP42780_c7bb5e4a9feccbe89cb1250222e2d355.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Reference Tech',
 'transmission': 'manual',
 'trim': 'Reference Tech',
 'year': 2014}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP42780%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.es] INFO: Saving data for PP42780: {'created_time': 1774695947.209147, 'last_price_update_time': 1774695947.209157, 'auction_closing_time': 1774885329.0}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PP42780') HTTP/1.1" 204 0
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_9886ac941c4afb0f30891e3c821708bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY33491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR52978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6460f10>
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F29%252F0a29ff7e3ec4a06a84be56cc6f40a701%252Fpa%252FFX69665_1ed8688f1cc45380214d3da309615ee2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ed8688f1cc45380214d3da309615ee2.jpg saved to cache
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31912ed9-d002-5f5f-b2f6-899f4a1c4683, skipping ID generation
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683 with scrape type 1
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31912ed9-d002-5f5f-b2f6-899f4a1c4683 sending to next pipeline
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31912ed9-d002-5f5f-b2f6-899f4a1c4683, identifier: FX69665
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31912ed9-d002-5f5f-b2f6-899f4a1c4683 with identifier: FX69665
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31912ed9-d002-5f5f-b2f6-899f4a1c4683 with identifier: FX69665
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31912ed9-d002-5f5f-b2f6-899f4a1c4683 with identifier: FX69665 to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ed8688f1cc45380214d3da309615ee2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:23:07Z',
 'fuel_type': 'diesel',
 'id': '31912ed9-d002-5f5f-b2f6-899f4a1c4683',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX69665',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 208716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ed8688f1cc45380214d3da309615ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_fe44580f357eee041d25eeb722ecbe7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_3941e01bfc5e18f9c7f46509c9efadab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_f405d4811ae89fdaa511b869bbf8be19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e2307b9164ae0d8ae932393659a94279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_43e309ca845d29ee3f88021e870fe20f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_e7e569ca2ef6eb9a90d2d59f97a1e49a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_1ff5c4b3c956becf7fe5d3e2c556cf70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31912ed9-d002-5f5f-b2f6-899f4a1c4683/31912ed9-d002-5f5f-b2f6-899f4a1c4683_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/29/0a29ff7e3ec4a06a84be56cc6f40a701/pa/FX69665_583727f56afd4ac07957d916438558ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2013}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX69665%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.es] INFO: Saving data for FX69665: {'created_time': 1774695947.834606, 'last_price_update_time': 1774695947.834616, 'auction_closing_time': 1774884187.0}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX69665') HTTP/1.1" 204 0
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85e8210>
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F3a%252Feb3a1cffc81f63588547f1a24c30ba3e%252Fpa%252FGF33961_9886ac941c4afb0f30891e3c821708bf.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_9886ac941c4afb0f30891e3c821708bf.jpg saved to cache
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fddcaa9-9de1-56cd-abb8-38828817deda
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fddcaa9-9de1-56cd-abb8-38828817deda, skipping ID generation
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fddcaa9-9de1-56cd-abb8-38828817deda with scrape type 1
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fddcaa9-9de1-56cd-abb8-38828817deda sending to next pipeline
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4fddcaa9-9de1-56cd-abb8-38828817deda, identifier: GF33961
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_9da0b4ec31e5048f79b654827bb5eb95.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4fddcaa9-9de1-56cd-abb8-38828817deda with identifier: GF33961
2026-03-28 11:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4fddcaa9-9de1-56cd-abb8-38828817deda with identifier: GF33961
2026-03-28 11:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4fddcaa9-9de1-56cd-abb8-38828817deda with identifier: GF33961 to the API
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_9886ac941c4afb0f30891e3c821708bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:58:19Z',
 'fuel_type': 'petrol',
 'id': '4fddcaa9-9de1-56cd-abb8-38828817deda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF33961',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 94753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_7c92d71699702a33a0de49b62d5feddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_9886ac941c4afb0f30891e3c821708bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_5fbfea48a2a8c854be157e0509e8bb55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_2d8ed4e8df73cc469fbdc06e40fc0103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_bf7a01a1ec43cadbcefee5d3dc52eeb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_4139417218509d449f847e2da0ad4173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fddcaa9-9de1-56cd-abb8-38828817deda/4fddcaa9-9de1-56cd-abb8-38828817deda_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/3a/eb3a1cffc81f63588547f1a24c30ba3e/pa/GF33961_cd6ea4aa4b5acbbcca5de13581e54e1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2017}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF33961%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.es] INFO: Saving data for GF33961: {'created_time': 1774695948.458372, 'last_price_update_time': 1774695948.458382, 'auction_closing_time': 1774886299.0}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF33961') HTTP/1.1" 204 0
2026-03-28 11:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a03650>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_9da0b4ec31e5048f79b654827bb5eb95.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_9da0b4ec31e5048f79b654827bb5eb95.jpg saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eda71ac3045624a7deec62c4c5d5a38.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_acdc66b0d25fad47b713d704eb030577.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a01510>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_5eda71ac3045624a7deec62c4c5d5a38.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eda71ac3045624a7deec62c4c5d5a38.jpg saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_dd18655d29a6589d4752c999aa047d00.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6451ad0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_acdc66b0d25fad47b713d704eb030577.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_acdc66b0d25fad47b713d704eb030577.jpg saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_414dc1f3c2e92dcbd0f611c48f6c579c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e6890>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_dd18655d29a6589d4752c999aa047d00.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_dd18655d29a6589d4752c999aa047d00.jpg saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_e5ef921aa19e2253aaa1302c0ffd4c86.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59c1790>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_414dc1f3c2e92dcbd0f611c48f6c579c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_414dc1f3c2e92dcbd0f611c48f6c579c.jpg saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_9b196c118cfc634f72c1181e174837ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a02210>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_e5ef921aa19e2253aaa1302c0ffd4c86.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_e5ef921aa19e2253aaa1302c0ffd4c86.jpg saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eb331bc2e4f1310c2ba664c9e6d22ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59c04d0>
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_9b196c118cfc634f72c1181e174837ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_9b196c118cfc634f72c1181e174837ee.jpg saved to cache
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_29531caf18dba99679d359b6455bec7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85e1d50>
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_5eb331bc2e4f1310c2ba664c9e6d22ad.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eb331bc2e4f1310c2ba664c9e6d22ad.jpg saved to cache
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_f48b7175fea1b2938ae7402cabecce49.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82eb390>
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_29531caf18dba99679d359b6455bec7c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_29531caf18dba99679d359b6455bec7c.jpg saved to cache
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6330dd0>
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_f48b7175fea1b2938ae7402cabecce49.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_f48b7175fea1b2938ae7402cabecce49.jpg saved to cache
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR52978> (referer: https://www.auto1.com/v1/car-details-view/SR52978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5954c10>
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F1a%252F401a86b9b61f204ff984217c14d82fc8%252Fpa%252FBK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg saved to cache
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b293699-8245-5747-8a11-0039aecf6f8b
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b293699-8245-5747-8a11-0039aecf6f8b, skipping ID generation
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b293699-8245-5747-8a11-0039aecf6f8b with scrape type 1
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b293699-8245-5747-8a11-0039aecf6f8b sending to next pipeline
2026-03-28 11:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b293699-8245-5747-8a11-0039aecf6f8b, identifier: BK75900
2026-03-28 11:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b293699-8245-5747-8a11-0039aecf6f8b with identifier: BK75900
2026-03-28 11:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b293699-8245-5747-8a11-0039aecf6f8b with identifier: BK75900
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b293699-8245-5747-8a11-0039aecf6f8b with identifier: BK75900 to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:05:30Z',
 'fuel_type': 'diesel',
 'id': '1b293699-8245-5747-8a11-0039aecf6f8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK75900',
 'listing': 'auction',
 'location': 'ES, Cabrera de Mar',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 183697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_b084f18ad10144f0ccf0f5da4f5897c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_f48b7175fea1b2938ae7402cabecce49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_29531caf18dba99679d359b6455bec7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eb331bc2e4f1310c2ba664c9e6d22ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_9b196c118cfc634f72c1181e174837ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_e5ef921aa19e2253aaa1302c0ffd4c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_414dc1f3c2e92dcbd0f611c48f6c579c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_dd18655d29a6589d4752c999aa047d00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_acdc66b0d25fad47b713d704eb030577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b293699-8245-5747-8a11-0039aecf6f8b/1b293699-8245-5747-8a11-0039aecf6f8b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/1a/401a86b9b61f204ff984217c14d82fc8/pa/BK75900_5eda71ac3045624a7deec62c4c5d5a38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.9 DDiS DDIS Comfort',
 'transmission': 'manual',
 'trim': 'DDIS Comfort',
 'year': 2007}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK75900%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.es] INFO: Saving data for BK75900: {'created_time': 1774695949.871363, 'last_price_update_time': 1774695949.871374, 'auction_closing_time': 1774883130.0}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK75900') HTTP/1.1" 204 0
2026-03-28 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c7c8ce039f112ca0ddb828f18a1c441c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX62344> (referer: https://www.auto1.com/v1/car-details-view/TX62344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a7378e-c91f-5018-99e2-f18006793514 with scrape type 1
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1a7378e-c91f-5018-99e2-f18006793514
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_f466272945b30ee1648a1fea08e95aed.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_f466272945b30ee1648a1fea08e95aed.jpg already downloaded
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_8a423ff7e6667378f0fe4dfa38dd7d42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_8a423ff7e6667378f0fe4dfa38dd7d42.jpg already downloaded
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_535f1ad692349065d263c07baa1ba747.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_535f1ad692349065d263c07baa1ba747.jpg already downloaded
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_1b0af499000956a83b4fdf2826fc7613.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_1b0af499000956a83b4fdf2826fc7613.jpg already downloaded
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_bdde31b9911eac07b930fc15da55b6fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_bdde31b9911eac07b930fc15da55b6fc.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_fa7b32405b3ef5b80002a0f8dc451551.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_fa7b32405b3ef5b80002a0f8dc451551.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_4adc66f509cb6db784ae13b036796238.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_4adc66f509cb6db784ae13b036796238.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_c15ba31f24346a59390bf7d56b8d3d36.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_c15ba31f24346a59390bf7d56b8d3d36.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_018a79ec16268573986f2c08202a1fd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_018a79ec16268573986f2c08202a1fd3.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffc%252F99fca0e6cf4e84d9d5613cb9cbc62106%252Fpa%252FSR52978_b44edd1f46da5eed0b0bdd78fa269603.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_b44edd1f46da5eed0b0bdd78fa269603.jpg already downloaded
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1a7378e-c91f-5018-99e2-f18006793514, identifier: SR52978
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978
2026-03-28 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978 to the API
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR52978>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'diesel',
 'id': 'd1a7378e-c91f-5018-99e2-f18006793514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR52978',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 90456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_f466272945b30ee1648a1fea08e95aed.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_8a423ff7e6667378f0fe4dfa38dd7d42.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_535f1ad692349065d263c07baa1ba747.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_1b0af499000956a83b4fdf2826fc7613.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_bdde31b9911eac07b930fc15da55b6fc.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_fa7b32405b3ef5b80002a0f8dc451551.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_4adc66f509cb6db784ae13b036796238.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_c15ba31f24346a59390bf7d56b8d3d36.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_018a79ec16268573986f2c08202a1fd3.jpg',
                'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_b44edd1f46da5eed0b0bdd78fa269603.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_f466272945b30ee1648a1fea08e95aed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_8a423ff7e6667378f0fe4dfa38dd7d42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_535f1ad692349065d263c07baa1ba747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_1b0af499000956a83b4fdf2826fc7613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_bdde31b9911eac07b930fc15da55b6fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_fa7b32405b3ef5b80002a0f8dc451551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_4adc66f509cb6db784ae13b036796238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_c15ba31f24346a59390bf7d56b8d3d36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_018a79ec16268573986f2c08202a1fd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a7378e-c91f-5018-99e2-f18006793514/d1a7378e-c91f-5018-99e2-f18006793514_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fc/99fca0e6cf4e84d9d5613cb9cbc62106/pa/SR52978_b44edd1f46da5eed0b0bdd78fa269603.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Reference Ecomotive',
 'transmission': 'manual',
 'trim': 'Reference Ecomotive',
 'year': 2009}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR52978%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.es] INFO: Saving data for SR52978: {'created_time': 1774695950.502423, 'last_price_update_time': 1774695950.502432, 'auction_closing_time': 1774883697.0}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR52978') HTTP/1.1" 204 0
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_818cf4547c969cee43fba95b898a0d8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY33491> (referer: https://www.auto1.com/v1/car-details-view/VY33491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63a3190>
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_c7c8ce039f112ca0ddb828f18a1c441c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c7c8ce039f112ca0ddb828f18a1c441c.jpg saved to cache
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6fa563c-edbb-5160-a197-0166b9861af6 with scrape type 1
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6fa563c-edbb-5160-a197-0166b9861af6
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_7fe3d61a52503dc63047fb25a196075f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_7fe3d61a52503dc63047fb25a196075f.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_575494f08db59192f2d47e0527047a0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_575494f08db59192f2d47e0527047a0d.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_9d2766c9317c871c885d8a8e6e32e140.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_9d2766c9317c871c885d8a8e6e32e140.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_9d50a13f01fb0e3db2699820596c209f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_9d50a13f01fb0e3db2699820596c209f.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_e64fa7576718181f1ced4f5c360e2456.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_e64fa7576718181f1ced4f5c360e2456.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_40478c994490ffaacfd43a5da93587aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_40478c994490ffaacfd43a5da93587aa.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_557d21db154c5177041005912d4fe242.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_557d21db154c5177041005912d4fe242.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_182680671b8c0f8ad61ac390702b2e42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_182680671b8c0f8ad61ac390702b2e42.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_bdaa673b33b99743944a1a97ed27ed13.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_bdaa673b33b99743944a1a97ed27ed13.jpg already downloaded
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5a%252Fea5ad071302b4738d6052a07d88e9d69%252Fpa%252FTX62344_cb0ed2ef442cfc73c904ccd698a30ecf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_cb0ed2ef442cfc73c904ccd698a30ecf.jpg already downloaded
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6fa563c-edbb-5160-a197-0166b9861af6, identifier: TX62344
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344
2026-03-28 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344 to the API
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX62344>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:27:06Z',
 'fuel_type': 'petrol',
 'id': 'd6fa563c-edbb-5160-a197-0166b9861af6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX62344',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 27420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_7fe3d61a52503dc63047fb25a196075f.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_575494f08db59192f2d47e0527047a0d.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_9d2766c9317c871c885d8a8e6e32e140.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_9d50a13f01fb0e3db2699820596c209f.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_e64fa7576718181f1ced4f5c360e2456.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_40478c994490ffaacfd43a5da93587aa.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_557d21db154c5177041005912d4fe242.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_182680671b8c0f8ad61ac390702b2e42.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_bdaa673b33b99743944a1a97ed27ed13.jpg',
                'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_cb0ed2ef442cfc73c904ccd698a30ecf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_7fe3d61a52503dc63047fb25a196075f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_575494f08db59192f2d47e0527047a0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_9d2766c9317c871c885d8a8e6e32e140.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_9d50a13f01fb0e3db2699820596c209f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_e64fa7576718181f1ced4f5c360e2456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_40478c994490ffaacfd43a5da93587aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_557d21db154c5177041005912d4fe242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_182680671b8c0f8ad61ac390702b2e42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_bdaa673b33b99743944a1a97ed27ed13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6fa563c-edbb-5160-a197-0166b9861af6/d6fa563c-edbb-5160-a197-0166b9861af6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5a/ea5ad071302b4738d6052a07d88e9d69/pa/TX62344_cb0ed2ef442cfc73c904ccd698a30ecf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX62344%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [auto1.es] INFO: Saving data for TX62344: {'created_time': 1774695951.734513, 'last_price_update_time': 1774695951.734525, 'auction_closing_time': 1774884426.0}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX62344') HTTP/1.1" 204 0
2026-03-28 11:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1efae153a810c98bfce5ae8927c02ba5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59307d0>
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_818cf4547c969cee43fba95b898a0d8f.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_818cf4547c969cee43fba95b898a0d8f.jpg saved to cache
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa11b18c-01dd-5ca2-b431-da5206e22ef1 with identifier: VY33491
2026-03-28 11:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa11b18c-01dd-5ca2-b431-da5206e22ef1 with scrape type 1
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_2c14a621106716bfcdb3ea630e2b72c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c14a621106716bfcdb3ea630e2b72c0.jpg not downloaded yet
2026-03-28 11:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c5fcb3a5cccd2f3b6d20026944bb6f98.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg not downloaded yet
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_ba33045e9b744bc362bc2437570fc1f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_ba33045e9b744bc362bc2437570fc1f2.jpg not downloaded yet
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630ce90>
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_1efae153a810c98bfce5ae8927c02ba5.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1efae153a810c98bfce5ae8927c02ba5.jpg saved to cache
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_7c76e728ec5db3bdc7a11e613462cd1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_7c76e728ec5db3bdc7a11e613462cd1b.jpg not downloaded yet
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_b7466c83fae35234eaeb5d214b7dca7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_b7466c83fae35234eaeb5d214b7dca7b.jpg not downloaded yet
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_fffbef40bcdf721e933eac51aa16f392.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_fffbef40bcdf721e933eac51aa16f392.jpg not downloaded yet
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_65aef40395242ea486594ab267a10f53.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_65aef40395242ea486594ab267a10f53.jpg not downloaded yet
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e4fd0>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_c5fcb3a5cccd2f3b6d20026944bb6f98.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c5fcb3a5cccd2f3b6d20026944bb6f98.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_a82455bf1c8093bded15dc422d868952.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_a82455bf1c8093bded15dc422d868952.jpg not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_f5b99eb740884795c305cd9f18f0984c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_f5b99eb740884795c305cd9f18f0984c.jpg not downloaded yet
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_11e7ed3153c79bb71db23b87a688b1a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_709092b9c5d8e4d1bf0ccdb6402ece7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_709092b9c5d8e4d1bf0ccdb6402ece7e.jpg not downloaded yet
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f650b250>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_11e7ed3153c79bb71db23b87a688b1a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_11e7ed3153c79bb71db23b87a688b1a1.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_20195c93dc11bc4f27da6c040e3e7b74.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_77a097956a97ea00331f00cde3d1fde7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645ee50>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_20195c93dc11bc4f27da6c040e3e7b74.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_20195c93dc11bc4f27da6c040e3e7b74.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_d47fbdebe0925db618a3bc82890cd49c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6476c50>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_77a097956a97ea00331f00cde3d1fde7.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_77a097956a97ea00331f00cde3d1fde7.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK77233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59c1790>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_d47fbdebe0925db618a3bc82890cd49c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_d47fbdebe0925db618a3bc82890cd49c.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_5e7bed9ee7936b92955313235cbfa81a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_e681229f5f9a15f5d0cab84ec923d551.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c14a621106716bfcdb3ea630e2b72c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62aeb90>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_5e7bed9ee7936b92955313235cbfa81a.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_5e7bed9ee7936b92955313235cbfa81a.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_f5b99eb740884795c305cd9f18f0984c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6450110>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_e681229f5f9a15f5d0cab84ec923d551.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_e681229f5f9a15f5d0cab84ec923d551.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5906e90>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_2c14a621106716bfcdb3ea630e2b72c0.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c14a621106716bfcdb3ea630e2b72c0.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_709092b9c5d8e4d1bf0ccdb6402ece7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f8590>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_f5b99eb740884795c305cd9f18f0984c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_f5b99eb740884795c305cd9f18f0984c.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_a82455bf1c8093bded15dc422d868952.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR06421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5904b50>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_709092b9c5d8e4d1bf0ccdb6402ece7e.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_709092b9c5d8e4d1bf0ccdb6402ece7e.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_65aef40395242ea486594ab267a10f53.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63a25d0>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_a82455bf1c8093bded15dc422d868952.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_a82455bf1c8093bded15dc422d868952.jpg saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_fffbef40bcdf721e933eac51aa16f392.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645bb90>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_65aef40395242ea486594ab267a10f53.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_65aef40395242ea486594ab267a10f53.jpg saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_b7466c83fae35234eaeb5d214b7dca7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a009d0>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_fffbef40bcdf721e933eac51aa16f392.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_fffbef40bcdf721e933eac51aa16f392.jpg saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_7c76e728ec5db3bdc7a11e613462cd1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6430e10>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_b7466c83fae35234eaeb5d214b7dca7b.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_b7466c83fae35234eaeb5d214b7dca7b.jpg saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_ba33045e9b744bc362bc2437570fc1f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a03550>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_7c76e728ec5db3bdc7a11e613462cd1b.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_7c76e728ec5db3bdc7a11e613462cd1b.jpg saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62fac10>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_ba33045e9b744bc362bc2437570fc1f2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_ba33045e9b744bc362bc2437570fc1f2.jpg saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6509950>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb7%252F50b7fc7d4a196b1cd289019a31eeb8b7%252Fpa%252FVY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa11b18c-01dd-5ca2-b431-da5206e22ef1
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa11b18c-01dd-5ca2-b431-da5206e22ef1, skipping ID generation
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa11b18c-01dd-5ca2-b431-da5206e22ef1 with scrape type 1
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa11b18c-01dd-5ca2-b431-da5206e22ef1 sending to next pipeline
2026-03-28 11:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa11b18c-01dd-5ca2-b431-da5206e22ef1, identifier: VY33491
2026-03-28 11:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa11b18c-01dd-5ca2-b431-da5206e22ef1 with identifier: VY33491
2026-03-28 11:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa11b18c-01dd-5ca2-b431-da5206e22ef1 with identifier: VY33491
2026-03-28 11:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa11b18c-01dd-5ca2-b431-da5206e22ef1 with identifier: VY33491 to the API
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:37Z',
 'fuel_type': 'diesel',
 'id': 'fa11b18c-01dd-5ca2-b431-da5206e22ef1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY33491',
 'listing': 'auction',
 'location': 'ES, Huelva',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 136929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c14a621106716bfcdb3ea630e2b72c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_2c4eb543dd56b5e969ba1ea0614b5193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_ba33045e9b744bc362bc2437570fc1f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_7c76e728ec5db3bdc7a11e613462cd1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_b7466c83fae35234eaeb5d214b7dca7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_fffbef40bcdf721e933eac51aa16f392.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_65aef40395242ea486594ab267a10f53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_a82455bf1c8093bded15dc422d868952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_f5b99eb740884795c305cd9f18f0984c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa11b18c-01dd-5ca2-b431-da5206e22ef1/fa11b18c-01dd-5ca2-b431-da5206e22ef1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b7/50b7fc7d4a196b1cd289019a31eeb8b7/pa/VY33491_709092b9c5d8e4d1bf0ccdb6402ece7e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY33491%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [auto1.es] INFO: Saving data for VY33491: {'created_time': 1774695953.974164, 'last_price_update_time': 1774695953.974175, 'auction_closing_time': 1774886377.0}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY33491') HTTP/1.1" 204 0
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_f758d59de74b9ff370417b4de95efaa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK77233> (referer: https://www.auto1.com/v1/car-details-view/RK77233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF82752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR06421> (referer: https://www.auto1.com/v1/car-details-view/NR06421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f648fd90>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_f758d59de74b9ff370417b4de95efaa3.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_f758d59de74b9ff370417b4de95efaa3.jpg saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68583f6-732b-561f-87fe-e556b752fb63 with identifier: RK77233
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68583f6-732b-561f-87fe-e556b752fb63 with scrape type 1
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_a3f50cec979e5d87902d7e467c532161.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a3f50cec979e5d87902d7e467c532161.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_58c2515368edb22cdbcf7d58d624213c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_58c2515368edb22cdbcf7d58d624213c.jpg not downloaded yet
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b with identifier: NR06421
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b with scrape type 1
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_1f871fcffa8de607404f8ef261464acc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1f871fcffa8de607404f8ef261464acc.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_5b0d4f2274d38fc11c5e59447a8a16ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_5b0d4f2274d38fc11c5e59447a8a16ce.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_19a2bb88fae83862083c6a5d0a5ad882.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_19a2bb88fae83862083c6a5d0a5ad882.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_ea37cb9a0a1de6dae6d55b937238b183.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_ea37cb9a0a1de6dae6d55b937238b183.jpg not downloaded yet
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_28c3d453e5620d22556143083ca818f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_2c4aa8ee8f8260e1dca6f380414ba88c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_2c4aa8ee8f8260e1dca6f380414ba88c.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_12c5e6a0816c8ff8453c69e7db32bd82.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_12c5e6a0816c8ff8453c69e7db32bd82.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_5623b940eee5fc8a126095a01e7b97a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_5623b940eee5fc8a126095a01e7b97a1.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_d150ccffde6e0e1f695aa42601af2028.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_d150ccffde6e0e1f695aa42601af2028.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_52da77714b1b637626ea46bfd32616b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_52da77714b1b637626ea46bfd32616b6.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_38cc5c4e87e9bc38ad6b257f5fa51bd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_38cc5c4e87e9bc38ad6b257f5fa51bd6.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_11dd189de896b41326eb0b5eec096d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_11dd189de896b41326eb0b5eec096d7c.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_a45827f71659cd8f89cefda7a36ee411.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a45827f71659cd8f89cefda7a36ee411.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_9223e80e19d240c25749759c50e0e712.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_9223e80e19d240c25749759c50e0e712.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_f1de76a5f7bdab5666bab58ea1c4d549.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_f1de76a5f7bdab5666bab58ea1c4d549.jpg not downloaded yet
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6430550>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_28c3d453e5620d22556143083ca818f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_28c3d453e5620d22556143083ca818f3.jpg saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_f195f49c93cf6d2c65d2f731f349aea0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_f195f49c93cf6d2c65d2f731f349aea0.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_da6641403233a7bfd6bd1a7500850905.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_da6641403233a7bfd6bd1a7500850905.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_49e41166a08bcb8642f4004f365f5acd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_49e41166a08bcb8642f4004f365f5acd.jpg not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_1826c0ad6cc475fad7743e5ccdb6a9a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1826c0ad6cc475fad7743e5ccdb6a9a0.jpg not downloaded yet
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_1c4b68e152cb3ee76f11204af057264a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_f21b8e393f1b65214e535f000fd4c104.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f0a90>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_1c4b68e152cb3ee76f11204af057264a.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_1c4b68e152cb3ee76f11204af057264a.jpg saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US29597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a45d0>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_f21b8e393f1b65214e535f000fd4c104.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_f21b8e393f1b65214e535f000fd4c104.jpg saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_1662067788f27a4e12a77afda5db4a9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63bae10>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_1662067788f27a4e12a77afda5db4a9a.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_1662067788f27a4e12a77afda5db4a9a.jpg saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a
2026-03-28 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a866018fc3e9f2118688e8623cc644e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_747443cfa5bb2d6bb2f5e2eb5650f144.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f71e76d0>
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_a866018fc3e9f2118688e8623cc644e2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a866018fc3e9f2118688e8623cc644e2.jpg saved to cache
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f641bb50>
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_747443cfa5bb2d6bb2f5e2eb5650f144.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_747443cfa5bb2d6bb2f5e2eb5650f144.jpg saved to cache
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_57b2d320438dbec123f896156d677578.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63334d0>
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_57b2d320438dbec123f896156d677578.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_57b2d320438dbec123f896156d677578.jpg saved to cache
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_ea37cb9a0a1de6dae6d55b937238b183.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8311790>
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F4f%252F1a4fa3bb86d9a9fe88604f97282c5694%252Fpa%252FJN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg saved to cache
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a
2026-03-28 11:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58e7b08d-45d3-553e-9f3b-5a6fb969de3a, skipping ID generation
2026-03-28 11:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a with scrape type 1
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58e7b08d-45d3-553e-9f3b-5a6fb969de3a sending to next pipeline
2026-03-28 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58e7b08d-45d3-553e-9f3b-5a6fb969de3a, identifier: JN16141
2026-03-28 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58e7b08d-45d3-553e-9f3b-5a6fb969de3a with identifier: JN16141
2026-03-28 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58e7b08d-45d3-553e-9f3b-5a6fb969de3a with identifier: JN16141
2026-03-28 11:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58e7b08d-45d3-553e-9f3b-5a6fb969de3a with identifier: JN16141 to the API
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:00:56Z',
 'fuel_type': 'petrol',
 'id': '58e7b08d-45d3-553e-9f3b-5a6fb969de3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN16141',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 96470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_d4ee87c888fa82df34041c1f6458d00f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_85defdc7f34f4f0a5beb16c2024d97b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_1662067788f27a4e12a77afda5db4a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_28c3d453e5620d22556143083ca818f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7b08d-45d3-553e-9f3b-5a6fb969de3a/58e7b08d-45d3-553e-9f3b-5a6fb969de3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/4f/1a4fa3bb86d9a9fe88604f97282c5694/pa/JN16141_11e7ed3153c79bb71db23b87a688b1a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 XS Pack',
 'transmission': 'manual',
 'trim': 'XS Pack',
 'year': 2006}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN16141%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [auto1.es] INFO: Saving data for JN16141: {'created_time': 1774695956.154862, 'last_price_update_time': 1774695956.154874, 'auction_closing_time': 1774882856.0}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JN16141') HTTP/1.1" 204 0
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1826c0ad6cc475fad7743e5ccdb6a9a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US29597> (referer: https://www.auto1.com/v1/car-details-view/US29597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f594ded0>
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_ea37cb9a0a1de6dae6d55b937238b183.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_ea37cb9a0a1de6dae6d55b937238b183.jpg saved to cache
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645e990>
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_1826c0ad6cc475fad7743e5ccdb6a9a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1826c0ad6cc475fad7743e5ccdb6a9a0.jpg saved to cache
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 with identifier: US29597
2026-03-28 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 with scrape type 1
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg not downloaded yet
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_5a1678e065984cd22c38e31ceda6c232.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_5a1678e065984cd22c38e31ceda6c232.jpg not downloaded yet
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_d509dcddfddc34270544d14d7a399470.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_d509dcddfddc34270544d14d7a399470.jpg not downloaded yet
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_49e41166a08bcb8642f4004f365f5acd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_e43dbd18ad56a122b88595f7ca8b64c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_e43dbd18ad56a122b88595f7ca8b64c2.jpg not downloaded yet
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_97f2950052a0144d42f97fc2a73023a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_97f2950052a0144d42f97fc2a73023a4.jpg not downloaded yet
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_61446bfe2bf22b043486fba3982519b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_61446bfe2bf22b043486fba3982519b7.jpg not downloaded yet
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_da6641403233a7bfd6bd1a7500850905.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58e29d0>
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_49e41166a08bcb8642f4004f365f5acd.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_49e41166a08bcb8642f4004f365f5acd.jpg saved to cache
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a4dd0>
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_da6641403233a7bfd6bd1a7500850905.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_da6641403233a7bfd6bd1a7500850905.jpg saved to cache
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_f195f49c93cf6d2c65d2f731f349aea0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_f1de76a5f7bdab5666bab58ea1c4d549.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6475350>
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_f195f49c93cf6d2c65d2f731f349aea0.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_f195f49c93cf6d2c65d2f731f349aea0.jpg saved to cache
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6433890>
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_f1de76a5f7bdab5666bab58ea1c4d549.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_f1de76a5f7bdab5666bab58ea1c4d549.jpg saved to cache
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_9223e80e19d240c25749759c50e0e712.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a45827f71659cd8f89cefda7a36ee411.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6477d10>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_9223e80e19d240c25749759c50e0e712.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_9223e80e19d240c25749759c50e0e712.jpg saved to cache
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6529190>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_a45827f71659cd8f89cefda7a36ee411.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a45827f71659cd8f89cefda7a36ee411.jpg saved to cache
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_11dd189de896b41326eb0b5eec096d7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_38cc5c4e87e9bc38ad6b257f5fa51bd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f641aad0>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_11dd189de896b41326eb0b5eec096d7c.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_11dd189de896b41326eb0b5eec096d7c.jpg saved to cache
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6332b10>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_38cc5c4e87e9bc38ad6b257f5fa51bd6.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_38cc5c4e87e9bc38ad6b257f5fa51bd6.jpg saved to cache
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_52da77714b1b637626ea46bfd32616b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_d509dcddfddc34270544d14d7a399470.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6475850>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_52da77714b1b637626ea46bfd32616b6.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_52da77714b1b637626ea46bfd32616b6.jpg saved to cache
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f641bd50>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_d509dcddfddc34270544d14d7a399470.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_d509dcddfddc34270544d14d7a399470.jpg saved to cache
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_61446bfe2bf22b043486fba3982519b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62e7510>
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_61446bfe2bf22b043486fba3982519b7.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_61446bfe2bf22b043486fba3982519b7.jpg saved to cache
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_97f2950052a0144d42f97fc2a73023a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_e43dbd18ad56a122b88595f7ca8b64c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f594cbd0>
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_97f2950052a0144d42f97fc2a73023a4.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_97f2950052a0144d42f97fc2a73023a4.jpg saved to cache
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_5a1678e065984cd22c38e31ceda6c232.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6529c50>
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_e43dbd18ad56a122b88595f7ca8b64c2.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_e43dbd18ad56a122b88595f7ca8b64c2.jpg saved to cache
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f594fb50>
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_5a1678e065984cd22c38e31ceda6c232.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_5a1678e065984cd22c38e31ceda6c232.jpg saved to cache
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_d150ccffde6e0e1f695aa42601af2028.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f594e690>
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12eee2a941292547bf313cbce28093%252Fpa%252FUS29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg saved to cache
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13
2026-03-28 11:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13, skipping ID generation
2026-03-28 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 with scrape type 1
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 sending to next pipeline
2026-03-28 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13, identifier: US29597
2026-03-28 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 with identifier: US29597
2026-03-28 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 with identifier: US29597
2026-03-28 11:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13 with identifier: US29597 to the API
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:18:30Z',
 'fuel_type': 'diesel',
 'id': 'd71eb8d8-e9a2-52c8-8df2-daeb0bf82c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US29597',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 170632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_0ac64e64d545aadc6d5c3bb661e02a4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_5a1678e065984cd22c38e31ceda6c232.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_d509dcddfddc34270544d14d7a399470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_e43dbd18ad56a122b88595f7ca8b64c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_97f2950052a0144d42f97fc2a73023a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13/d71eb8d8-e9a2-52c8-8df2-daeb0bf82c13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12eee2a941292547bf313cbce28093/pa/US29597_61446bfe2bf22b043486fba3982519b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 1.6 HDi XS',
 'transmission': 'manual',
 'trim': 'XS',
 'year': 2006}
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US29597%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [auto1.es] INFO: Saving data for US29597: {'created_time': 1774695959.755651, 'last_price_update_time': 1774695959.75566, 'auction_closing_time': 1774883910.0}
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US29597') HTTP/1.1" 204 0
2026-03-28 11:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_5623b940eee5fc8a126095a01e7b97a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6419850>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_d150ccffde6e0e1f695aa42601af2028.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_d150ccffde6e0e1f695aa42601af2028.jpg saved to cache
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_12c5e6a0816c8ff8453c69e7db32bd82.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85e1ed0>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_5623b940eee5fc8a126095a01e7b97a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_5623b940eee5fc8a126095a01e7b97a1.jpg saved to cache
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_2c4aa8ee8f8260e1dca6f380414ba88c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630d790>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_12c5e6a0816c8ff8453c69e7db32bd82.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_12c5e6a0816c8ff8453c69e7db32bd82.jpg saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85e1c10>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_2c4aa8ee8f8260e1dca6f380414ba88c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_2c4aa8ee8f8260e1dca6f380414ba88c.jpg saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_19a2bb88fae83862083c6a5d0a5ad882.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_5b0d4f2274d38fc11c5e59447a8a16ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1f871fcffa8de607404f8ef261464acc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630d450>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_19a2bb88fae83862083c6a5d0a5ad882.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_19a2bb88fae83862083c6a5d0a5ad882.jpg saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_58c2515368edb22cdbcf7d58d624213c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f0f10>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_5b0d4f2274d38fc11c5e59447a8a16ce.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_5b0d4f2274d38fc11c5e59447a8a16ce.jpg saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85e2590>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe2%252F20e2825fed6fa999f58f9f54923a8c31%252Fpa%252FNR06421_1f871fcffa8de607404f8ef261464acc.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1f871fcffa8de607404f8ef261464acc.jpg saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b
2026-03-28 11:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b, skipping ID generation
2026-03-28 11:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b with scrape type 1
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b sending to next pipeline
2026-03-28 11:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b, identifier: NR06421
2026-03-28 11:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b with identifier: NR06421
2026-03-28 11:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b with identifier: NR06421
2026-03-28 11:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b with identifier: NR06421 to the API
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1f871fcffa8de607404f8ef261464acc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:12Z',
 'fuel_type': 'diesel',
 'id': '3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR06421',
 'listing': 'auction',
 'location': 'ES, Majadahonda, Madrid',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 155814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1f871fcffa8de607404f8ef261464acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_19a2bb88fae83862083c6a5d0a5ad882.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_2c4aa8ee8f8260e1dca6f380414ba88c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_5623b940eee5fc8a126095a01e7b97a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_52da77714b1b637626ea46bfd32616b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_11dd189de896b41326eb0b5eec096d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_9223e80e19d240c25749759c50e0e712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_f195f49c93cf6d2c65d2f731f349aea0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_49e41166a08bcb8642f4004f365f5acd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b/3f6e0a38-01ec-5bd6-8267-11fa45cbfa7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e2/20e2825fed6fa999f58f9f54923a8c31/pa/NR06421_1826c0ad6cc475fad7743e5ccdb6a9a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Advanced edition',
 'transmission': 'automatic',
 'trim': 'quattro Advanced edition',
 'year': 2016}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR06421%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [auto1.es] INFO: Saving data for NR06421: {'created_time': 1774695961.377647, 'last_price_update_time': 1774695961.377656, 'auction_closing_time': 1774883712.0}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NR06421') HTTP/1.1" 204 0
2026-03-28 11:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a3f50cec979e5d87902d7e467c532161.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF82752> (referer: https://www.auto1.com/v1/car-details-view/XF82752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR07700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58e1790>
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_58c2515368edb22cdbcf7d58d624213c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_58c2515368edb22cdbcf7d58d624213c.jpg saved to cache
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f594d250>
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fac%252F96ac458f08ebd1982df6a1269d1840b0%252Fpa%252FRK77233_a3f50cec979e5d87902d7e467c532161.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a3f50cec979e5d87902d7e467c532161.jpg saved to cache
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b68583f6-732b-561f-87fe-e556b752fb63
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b68583f6-732b-561f-87fe-e556b752fb63, skipping ID generation
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68583f6-732b-561f-87fe-e556b752fb63 with scrape type 1
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b68583f6-732b-561f-87fe-e556b752fb63 sending to next pipeline
2026-03-28 11:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b68583f6-732b-561f-87fe-e556b752fb63, identifier: RK77233
2026-03-28 11:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b68583f6-732b-561f-87fe-e556b752fb63 with identifier: RK77233
2026-03-28 11:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b68583f6-732b-561f-87fe-e556b752fb63 with identifier: RK77233
2026-03-28 11:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b68583f6-732b-561f-87fe-e556b752fb63 with identifier: RK77233 to the API
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a3f50cec979e5d87902d7e467c532161.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:43:30Z',
 'fuel_type': 'diesel',
 'id': 'b68583f6-732b-561f-87fe-e556b752fb63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK77233',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 230066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a3f50cec979e5d87902d7e467c532161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_58c2515368edb22cdbcf7d58d624213c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_5b0d4f2274d38fc11c5e59447a8a16ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_ea37cb9a0a1de6dae6d55b937238b183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_12c5e6a0816c8ff8453c69e7db32bd82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_d150ccffde6e0e1f695aa42601af2028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_38cc5c4e87e9bc38ad6b257f5fa51bd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_a45827f71659cd8f89cefda7a36ee411.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_f1de76a5f7bdab5666bab58ea1c4d549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68583f6-732b-561f-87fe-e556b752fb63/b68583f6-732b-561f-87fe-e556b752fb63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/ac/96ac458f08ebd1982df6a1269d1840b0/pa/RK77233_da6641403233a7bfd6bd1a7500850905.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK77233%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.es] INFO: Saving data for RK77233: {'created_time': 1774695962.070467, 'last_price_update_time': 1774695962.070481, 'auction_closing_time': 1774885410.0}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK77233') HTTP/1.1" 204 0
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_74cb13b18023f0b25e75679e8a39ae1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd177684-81d5-56c5-bb9d-436c56f3b3f1 with identifier: XF82752
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd177684-81d5-56c5-bb9d-436c56f3b3f1 with scrape type 1
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_491ab547d65e5b688acc27da8cc12c99.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_491ab547d65e5b688acc27da8cc12c99.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_e390e94ddd7e4a2ff44f711a70848877.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e390e94ddd7e4a2ff44f711a70848877.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_e9682b6fd79f562060d5b2236c7664ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e9682b6fd79f562060d5b2236c7664ef.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_81eb96c58bb8ab1c7ff93f043ed22af6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_81eb96c58bb8ab1c7ff93f043ed22af6.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_fa69e4d086027434e2c75a83b5dfeac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_fa69e4d086027434e2c75a83b5dfeac5.jpg not downloaded yet
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1b5c3544bdf26784bef0ca568362dd2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_bed62fbe5d5dcbf6a73bf2b6514cced1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_bed62fbe5d5dcbf6a73bf2b6514cced1.jpg not downloaded yet
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f3390>
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_74cb13b18023f0b25e75679e8a39ae1e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_74cb13b18023f0b25e75679e8a39ae1e.jpg saved to cache
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_df3b945c134a8aad71ca02c78c10dd96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_df3b945c134a8aad71ca02c78c10dd96.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_b354932b0bb3bf24c4e2258ba0df92de.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_b354932b0bb3bf24c4e2258ba0df92de.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_e205e970464c50515d861f00fa11bc76.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e205e970464c50515d861f00fa11bc76.jpg not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_2cebf94b4bb3d8d6afc00caa30bcf99f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_2cebf94b4bb3d8d6afc00caa30bcf99f.jpg not downloaded yet
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_fa158e0adb0c07702dad637e474ff40b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62adc10>
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_1b5c3544bdf26784bef0ca568362dd2f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1b5c3544bdf26784bef0ca568362dd2f.jpg saved to cache
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6450910>
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_fa158e0adb0c07702dad637e474ff40b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_fa158e0adb0c07702dad637e474ff40b.jpg saved to cache
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:02 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2557 | hits on page: 40
2026-03-28 11:06:02 [auto1.es] INFO: Found listing with ID: PP42780
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP42780%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.es] INFO: Scrape type for PP42780: 0
2026-03-28 11:06:02 [auto1.es] INFO: Found listing with ID: EK21860
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK21860%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.es] INFO: Scrape type for EK21860: 0
2026-03-28 11:06:02 [auto1.es] INFO: Found listing with ID: EM88527
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM88527%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.es] INFO: Scrape type for EM88527: 1
2026-03-28 11:06:02 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML70720%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.es] INFO: Scrape type for ML70720: 1
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6474910>
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d53230451a376c42e0d162eaa97508%252Fpa%252FMM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg saved to cache
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01359fed-d4b0-5252-ba34-9ce842217476
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01359fed-d4b0-5252-ba34-9ce842217476, skipping ID generation
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01359fed-d4b0-5252-ba34-9ce842217476 with scrape type 1
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01359fed-d4b0-5252-ba34-9ce842217476 sending to next pipeline
2026-03-28 11:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01359fed-d4b0-5252-ba34-9ce842217476, identifier: MM24927
2026-03-28 11:06:02 [auto1.es] INFO: Found listing with ID: XA25667
2026-03-28 11:06:02 [auto1.es] INFO: Found listing with ID: LH42756
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH42756%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.es] INFO: Scrape type for LH42756: 1
2026-03-28 11:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01359fed-d4b0-5252-ba34-9ce842217476 with identifier: MM24927
2026-03-28 11:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01359fed-d4b0-5252-ba34-9ce842217476 with identifier: MM24927
2026-03-28 11:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01359fed-d4b0-5252-ba34-9ce842217476 with identifier: MM24927 to the API
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:23:21Z',
 'fuel_type': 'diesel',
 'id': '01359fed-d4b0-5252-ba34-9ce842217476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM24927',
 'listing': 'auction',
 'location': 'ES, El Ejido',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 144000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a7b053fb50bb5ad13757e8b68ef926ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_74cb13b18023f0b25e75679e8a39ae1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_a866018fc3e9f2118688e8623cc644e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_1c4b68e152cb3ee76f11204af057264a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_5e7bed9ee7936b92955313235cbfa81a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_20195c93dc11bc4f27da6c040e3e7b74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_cec8693c62f8ef4c4d96da585950299d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01359fed-d4b0-5252-ba34-9ce842217476/01359fed-d4b0-5252-ba34-9ce842217476_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d53230451a376c42e0d162eaa97508/pa/MM24927_9da0b4ec31e5048f79b654827bb5eb95.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2016}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM24927%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.es] INFO: Saving data for MM24927: {'created_time': 1774695963.101311, 'last_price_update_time': 1774695963.10132, 'auction_closing_time': 1774884201.0}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MM24927') HTTP/1.1" 204 0
2026-03-28 11:06:03 [auto1.es] INFO: Found listing with ID: YS26400
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS26400%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.es] INFO: Scrape type for YS26400: 1
2026-03-28 11:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_78c37d76339a62335b74dec3299c9126.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP31470> (referer: https://www.auto1.com/v1/car-details-view/HP31470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6397b90>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F31%252F6631f8638649ffe1d7a1cf334cff28fb%252Fpa%252FBF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6
2026-03-28 11:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6, skipping ID generation
2026-03-28 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 with scrape type 1
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 sending to next pipeline
2026-03-28 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6, identifier: BF82684
2026-03-28 11:06:03 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL67174%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.es] INFO: Scrape type for DL67174: 2
2026-03-28 11:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-03-28 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0a60d5-e253-560b-971d-6acef668247b with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0a60d5-e253-560b-971d-6acef668247b with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f0a60d5-e253-560b-971d-6acef668247b, identifier: DL67174
2026-03-28 11:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 with identifier: BF82684
2026-03-28 11:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 with identifier: BF82684
2026-03-28 11:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97c4d001-49d3-50c8-8e0a-5502ebb0a1d6 with identifier: BF82684 to the API
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'petrol',
 'id': '97c4d001-49d3-50c8-8e0a-5502ebb0a1d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF82684',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 186526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_0a4dce5ab79ce2112af4d44639f63bd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1b5c3544bdf26784bef0ca568362dd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_747443cfa5bb2d6bb2f5e2eb5650f144.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_f21b8e393f1b65214e535f000fd4c104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_e681229f5f9a15f5d0cab84ec923d551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_77a097956a97ea00331f00cde3d1fde7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c5fcb3a5cccd2f3b6d20026944bb6f98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_1efae153a810c98bfce5ae8927c02ba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c4d001-49d3-50c8-8e0a-5502ebb0a1d6/97c4d001-49d3-50c8-8e0a-5502ebb0a1d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/31/6631f8638649ffe1d7a1cf334cff28fb/pa/BF82684_c7c8ce039f112ca0ddb828f18a1c441c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Advance BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion Tech',
 'year': 2013}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF82684%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.es] INFO: Saving data for BF82684: {'created_time': 1774695963.832969, 'last_price_update_time': 1774695963.832982, 'auction_closing_time': 1774884614.0}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BF82684') HTTP/1.1" 204 0
2026-03-28 11:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-03-28 11:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-03-28 11:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174 to the API
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:29Z',
 'fuel_type': 'diesel',
 'id': '7f0a60d5-e253-560b-971d-6acef668247b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL67174',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 246968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2014}
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL67174%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [auto1.es] INFO: Saving data for DL67174: {'auction_closing_time': 1774884389.0, 'created_time': 1774015813.098778, 'last_price_update_time': 1774695964.759263}
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL67174') HTTP/1.1" 204 0
2026-03-28 11:06:04 [auto1.es] INFO: Found listing with ID: VT22035
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT22035%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [auto1.es] INFO: Scrape type for VT22035: 1
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a67d0>
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_78c37d76339a62335b74dec3299c9126.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_78c37d76339a62335b74dec3299c9126.jpg saved to cache
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-03-28 11:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with scrape type 1
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_acb736228a5868f9e2a35d4767f16bba.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_7e27a4ef92d09b565118b90a663bed31.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_4d213828839ac42b246d86bb05e27d73.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg already downloaded
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_5999890793ba5d3c292bf69532eb1b44.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg already downloaded
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg already downloaded
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fdb%252F61dbe8ae17a9925c397f1ffacfbe7398%252Fpa%252FHP31470_6c4ff7f21367158f03857149d6011f48.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg already downloaded
2026-03-28 11:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2, identifier: HP31470
2026-03-28 11:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-03-28 11:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470 to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HP31470>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:01Z',
 'fuel_type': 'diesel',
 'id': '8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP31470',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 57625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg',
                'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP31470%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.es] INFO: Saving data for HP31470: {'created_time': 1774695965.445191, 'last_price_update_time': 1774695965.445202, 'auction_closing_time': 1774885561.0}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HP31470') HTTP/1.1" 204 0
2026-03-28 11:06:05 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 73 pages/min), scraped 31 items (at 31 items/min)
2026-03-28 11:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-28 11:06:05 [auto1.es] INFO: Found listing with ID: BM94316
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM94316%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.es] INFO: Scrape type for BM94316: 1
2026-03-28 11:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:05 [auto1.es] INFO: Found listing with ID: NP14618
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP14618%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.es] INFO: Scrape type for NP14618: 1
2026-03-28 11:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5942350>
2026-03-28 11:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F8d%252F098d55d736946d3a17de3f6c1edda440%252Fpa%252FEH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg saved to cache
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b134e5f-7685-5c85-a18a-01a3c81b1594
2026-03-28 11:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b134e5f-7685-5c85-a18a-01a3c81b1594, skipping ID generation
2026-03-28 11:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b134e5f-7685-5c85-a18a-01a3c81b1594 with scrape type 1
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b134e5f-7685-5c85-a18a-01a3c81b1594 sending to next pipeline
2026-03-28 11:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b134e5f-7685-5c85-a18a-01a3c81b1594, identifier: EH03748
2026-03-28 11:06:05 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS21138%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.es] INFO: Scrape type for MS21138: 1
2026-03-28 11:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b134e5f-7685-5c85-a18a-01a3c81b1594 with identifier: EH03748
2026-03-28 11:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b134e5f-7685-5c85-a18a-01a3c81b1594 with identifier: EH03748
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b134e5f-7685-5c85-a18a-01a3c81b1594 with identifier: EH03748 to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:55:36Z',
 'fuel_type': 'diesel',
 'id': '2b134e5f-7685-5c85-a18a-01a3c81b1594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH03748',
 'listing': 'auction',
 'location': 'ES, Atarfe, Granada',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 108309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_4ddd7c61938cd8a3e0fe56a9bb068e8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_78c37d76339a62335b74dec3299c9126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_fa158e0adb0c07702dad637e474ff40b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_57b2d320438dbec123f896156d677578.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_9360f97df5934bd9ecd5aec4b178f786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_f758d59de74b9ff370417b4de95efaa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_d47fbdebe0925db618a3bc82890cd49c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b134e5f-7685-5c85-a18a-01a3c81b1594/2b134e5f-7685-5c85-a18a-01a3c81b1594_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/8d/098d55d736946d3a17de3f6c1edda440/pa/EH03748_818cf4547c969cee43fba95b898a0d8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH03748%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Saving data for EH03748: {'created_time': 1774695966.066857, 'last_price_update_time': 1774695966.066868, 'auction_closing_time': 1774886136.0}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH03748') HTTP/1.1" 204 0
2026-03-28 11:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_9d8319331c46ad6d2678dd8936d67e29.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG18417%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Scrape type for EG18417: 2
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3707387-1b88-5d16-a811-afc8357ab3c8 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3707387-1b88-5d16-a811-afc8357ab3c8 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3707387-1b88-5d16-a811-afc8357ab3c8, identifier: EG18417
2026-03-28 11:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417
2026-03-28 11:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417
2026-03-28 11:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417 to the API
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:49:17Z',
 'fuel_type': 'diesel',
 'id': 'e3707387-1b88-5d16-a811-afc8357ab3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG18417',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 232088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-16',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi SX Plus',
 'transmission': 'manual',
 'trim': 'SX Plus',
 'year': 2003}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG18417%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Saving data for EG18417: {'auction_closing_time': 1774885757.0, 'created_time': 1774037150.416479, 'last_price_update_time': 1774695966.543739}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG18417') HTTP/1.1" 204 0
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: MH61134
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH61134%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Scrape type for MH61134: 1
2026-03-28 11:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_fa69e4d086027434e2c75a83b5dfeac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: SJ29812
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: YR47021
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR47021%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Scrape type for YR47021: 1
2026-03-28 11:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59a8e90>
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd77e97-e526-57a7-8404-362f17856991/fcd77e97-e526-57a7-8404-362f17856991_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_9d8319331c46ad6d2678dd8936d67e29.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_9d8319331c46ad6d2678dd8936d67e29.jpg saved to cache
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcd77e97-e526-57a7-8404-362f17856991
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD15587%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Scrape type for HD15587: 1
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: RV46161
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV46161%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Scrape type for RV46161: 1
2026-03-28 11:06:06 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE52894%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.es] INFO: Scrape type for BE52894: 2
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bee3e6c-d88c-5935-b130-d834f69a1b81 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bee3e6c-d88c-5935-b130-d834f69a1b81 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bee3e6c-d88c-5935-b130-d834f69a1b81, identifier: BE52894
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894
2026-03-28 11:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894 to the API
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:32:55Z',
 'fuel_type': 'hybrid',
 'id': '7bee3e6c-d88c-5935-b130-d834f69a1b81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE52894',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius+',
 'odometer': 248650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-29',
 'seller_name': None,
 'title': 'Toyota Prius+ 1.8 Hybrid Dynamic Business',
 'transmission': 'automatic',
 'trim': 'Dynamic Business',
 'year': 2012}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE52894%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Saving data for BE52894: {'auction_closing_time': 1774884775.0, 'created_time': 1774002157.56526, 'last_price_update_time': 1774695967.24506}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE52894') HTTP/1.1" 204 0
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: VG10975
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG10975%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for VG10975: 1
2026-03-28 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e205e970464c50515d861f00fa11bc76.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS26400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH42756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f647c050>
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_fa69e4d086027434e2c75a83b5dfeac5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_fa69e4d086027434e2c75a83b5dfeac5.jpg saved to cache
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: VC46387
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: PT83214
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: JM22028
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE06656%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for BE06656: 1
2026-03-28 11:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: BB43424
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB43424%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for BB43424: 1
2026-03-28 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT22035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: PP51748
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: UR52438
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR52438%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for UR52438: 1
2026-03-28 11:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: PS14149
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS14149%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for PS14149: 1
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB85500%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for GB85500: 1
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f592e310>
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_e205e970464c50515d861f00fa11bc76.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e205e970464c50515d861f00fa11bc76.jpg saved to cache
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: MM10114
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: HB49696
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB49696%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for HB49696: 1
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: BD69274
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: ES13897
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: PD50482
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: FP09547
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP09547%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for FP09547: 1
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: KU62533
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU62533%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for KU62533: 1
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: JZ72773
2026-03-28 11:06:07 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX89883%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.es] INFO: Scrape type for SX89883: 2
2026-03-28 11:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883
2026-03-28 11:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346cd28f-8696-5f0e-9ce1-899a11aa5816 with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 346cd28f-8696-5f0e-9ce1-899a11aa5816 with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 346cd28f-8696-5f0e-9ce1-899a11aa5816, identifier: SX89883
2026-03-28 11:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 11:06:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883
2026-03-28 11:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883 to the API
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:56:27Z',
 'fuel_type': 'petrol',
 'id': '346cd28f-8696-5f0e-9ce1-899a11aa5816',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX89883',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Accord',
 'odometer': 68180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-28',
 'seller_name': None,
 'title': 'Honda Accord 2.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2004}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX89883%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [auto1.es] INFO: Saving data for SX89883: {'auction_closing_time': 1774886187.0, 'created_time': 1774350714.354069, 'last_price_update_time': 1774695968.201255}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SX89883') HTTP/1.1" 204 0
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_2cebf94b4bb3d8d6afc00caa30bcf99f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH61134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS21138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645a490>
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_2cebf94b4bb3d8d6afc00caa30bcf99f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_2cebf94b4bb3d8d6afc00caa30bcf99f.jpg saved to cache
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_b354932b0bb3bf24c4e2258ba0df92de.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a78d0>
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_b354932b0bb3bf24c4e2258ba0df92de.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_b354932b0bb3bf24c4e2258ba0df92de.jpg saved to cache
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_df3b945c134a8aad71ca02c78c10dd96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB43424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8329250>
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_df3b945c134a8aad71ca02c78c10dd96.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_df3b945c134a8aad71ca02c78c10dd96.jpg saved to cache
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU62533/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV46161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD15587/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP09547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT22035> (referer: https://www.auto1.com/v1/car-details-view/VT22035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS21138> (referer: https://www.auto1.com/v1/car-details-view/MS21138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1549ea02-6e9b-55fc-95a9-d7ac93c69656 with identifier: VT22035
2026-03-28 11:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656 with scrape type 1
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_4e13a828354a31f76600f8ef8d493e9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_4e13a828354a31f76600f8ef8d493e9e.jpg not downloaded yet
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_f404d84b782b46818a1edb2389f5a47b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_f404d84b782b46818a1edb2389f5a47b.jpg not downloaded yet
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_359b9ddb86b964d5e866d8a3e9b60b4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_359b9ddb86b964d5e866d8a3e9b60b4b.jpg not downloaded yet
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_e88ec220cb0552fa515880b40cd2ef4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_e88ec220cb0552fa515880b40cd2ef4c.jpg not downloaded yet
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_3dbb3699a505f0b9284e146f17350296.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_3dbb3699a505f0b9284e146f17350296.jpg not downloaded yet
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_11fb148ef0e964d1e3c447270fcfe886.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_11fb148ef0e964d1e3c447270fcfe886.jpg not downloaded yet
2026-03-28 11:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138
2026-03-28 11:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with scrape type 1
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1459d18b-252e-55ba-b8fb-5a48a8af25c7
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_2dfb22683909343c851e6f20a9bbfc22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_2dfb22683909343c851e6f20a9bbfc22.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_76268ed688d3bf9521a966da70a30f62.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_76268ed688d3bf9521a966da70a30f62.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_5611d68cb3b87095fddd7845be7f4139.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_5611d68cb3b87095fddd7845be7f4139.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_2c829dad0daeb4a34027ec9d54b48e05.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_2c829dad0daeb4a34027ec9d54b48e05.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_1c30cda4af5cdf5e6600c0d6e9ef87cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_1c30cda4af5cdf5e6600c0d6e9ef87cc.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_e7f3f189c7ac62c1c1b4600a66b9e3ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_e7f3f189c7ac62c1c1b4600a66b9e3ff.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_d7ff4e6cfa50528f3f9cc74543e20fca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_d7ff4e6cfa50528f3f9cc74543e20fca.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_f034c514fb0eb9031813d5e1af5aaf1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_f034c514fb0eb9031813d5e1af5aaf1e.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_365838047b0ddb2e6a02274f162a27f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_365838047b0ddb2e6a02274f162a27f0.jpg already downloaded
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F19%252F8b19177d57ed7125da5ad6b0d7eac440%252Fpa%252FMS21138_5b2e301e73ecdae18e71efb61381095b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_5b2e301e73ecdae18e71efb61381095b.jpg already downloaded
2026-03-28 11:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1459d18b-252e-55ba-b8fb-5a48a8af25c7, identifier: MS21138
2026-03-28 11:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138
2026-03-28 11:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138
2026-03-28 11:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138 to the API
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MS21138>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:20:05Z',
 'fuel_type': 'diesel',
 'id': '1459d18b-252e-55ba-b8fb-5a48a8af25c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS21138',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 222056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_2dfb22683909343c851e6f20a9bbfc22.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_76268ed688d3bf9521a966da70a30f62.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_5611d68cb3b87095fddd7845be7f4139.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_2c829dad0daeb4a34027ec9d54b48e05.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_1c30cda4af5cdf5e6600c0d6e9ef87cc.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_e7f3f189c7ac62c1c1b4600a66b9e3ff.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_d7ff4e6cfa50528f3f9cc74543e20fca.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_f034c514fb0eb9031813d5e1af5aaf1e.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_365838047b0ddb2e6a02274f162a27f0.jpg',
                'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_5b2e301e73ecdae18e71efb61381095b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_2dfb22683909343c851e6f20a9bbfc22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_76268ed688d3bf9521a966da70a30f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_5611d68cb3b87095fddd7845be7f4139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_2c829dad0daeb4a34027ec9d54b48e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_1c30cda4af5cdf5e6600c0d6e9ef87cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_e7f3f189c7ac62c1c1b4600a66b9e3ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_d7ff4e6cfa50528f3f9cc74543e20fca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_f034c514fb0eb9031813d5e1af5aaf1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_365838047b0ddb2e6a02274f162a27f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1459d18b-252e-55ba-b8fb-5a48a8af25c7/1459d18b-252e-55ba-b8fb-5a48a8af25c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/19/8b19177d57ed7125da5ad6b0d7eac440/pa/MS21138_5b2e301e73ecdae18e71efb61381095b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi XTR Plus',
 'transmission': 'manual',
 'trim': 'XTR Plus',
 'year': 2014}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS21138%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [auto1.es] INFO: Saving data for MS21138: {'created_time': 1774695970.085935, 'last_price_update_time': 1774695970.085946, 'auction_closing_time': 1774884005.0}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS21138') HTTP/1.1" 204 0
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH61134> (referer: https://www.auto1.com/v1/car-details-view/MH61134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG10975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB49696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB43424> (referer: https://www.auto1.com/v1/car-details-view/BB43424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230f32e4-d2de-5e50-a895-45784111aab5 with identifier: MH61134
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230f32e4-d2de-5e50-a895-45784111aab5 with scrape type 1
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_33930775d303e7a8085065cf516c04dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_33930775d303e7a8085065cf516c04dc.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_099d0a443275f44501a6dfdf8e0fed3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_099d0a443275f44501a6dfdf8e0fed3e.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_5e288c3acaab7ab489f1182df860a38e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_5e288c3acaab7ab489f1182df860a38e.jpg not downloaded yet
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3501197-aa1b-5c6c-b8b0-4e96ccccc549 with identifier: BB43424
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549 with scrape type 1
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_3879149b2fd9d82684950f710ab33763.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_3879149b2fd9d82684950f710ab33763.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_75e591fcc3f9f1311a3e3c11c42eff95.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_75e591fcc3f9f1311a3e3c11c42eff95.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_e2fb04e09fd9a9b2d566d64360354f84.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_e2fb04e09fd9a9b2d566d64360354f84.jpg not downloaded yet
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS26400> (referer: https://www.auto1.com/v1/car-details-view/YS26400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_17d0a462840ffdc337cbff536ecc6125.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_17d0a462840ffdc337cbff536ecc6125.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_c5eb70c7cb42917f617230b933f68aa9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_c5eb70c7cb42917f617230b933f68aa9.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_8ded96f1cf5476a45cd37b61c8b22ea2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_8ded96f1cf5476a45cd37b61c8b22ea2.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_0e9a73174a45a6394744e5a7f0f91b85.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_0e9a73174a45a6394744e5a7f0f91b85.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_d4b261ab2865fff9b60ade121378b4de.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_d4b261ab2865fff9b60ade121378b4de.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_df52ab2628c243d8c88b141541cbe3bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_df52ab2628c243d8c88b141541cbe3bd.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_f782a5e36c60e5c1c7cf5bcd238ba677.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_f782a5e36c60e5c1c7cf5bcd238ba677.jpg not downloaded yet
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_11fb148ef0e964d1e3c447270fcfe886.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_2a5eb993c1fae86ab941844e06db7dfe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_2a5eb993c1fae86ab941844e06db7dfe.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_e81b13051e070f76350abe3bfd17f919.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_e81b13051e070f76350abe3bfd17f919.jpg not downloaded yet
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b833916-c9c6-5d91-89b7-e43b02517a4d with identifier: YS26400
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b833916-c9c6-5d91-89b7-e43b02517a4d with scrape type 1
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_906e9974741b105c3804757a74f53296.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_906e9974741b105c3804757a74f53296.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_fedacd0bec4eec9f0792f9e1735b80aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_fedacd0bec4eec9f0792f9e1735b80aa.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_88f0327e494aaa9e55a25c613f4b3df1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_88f0327e494aaa9e55a25c613f4b3df1.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_51fe077990687627e2b7e38b550f37fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_51fe077990687627e2b7e38b550f37fd.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_4161db930829b858506bef387b26a7ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_4161db930829b858506bef387b26a7ff.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_a2f8bcff5dbce26cda67ce8386403157.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_a2f8bcff5dbce26cda67ce8386403157.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_bdaa0f7e1719ae1b2c896849421c1321.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_bdaa0f7e1719ae1b2c896849421c1321.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_7b4d17ca3f729503a277c9237daa45ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_7b4d17ca3f729503a277c9237daa45ac.jpg not downloaded yet
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a4510>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_11fb148ef0e964d1e3c447270fcfe886.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_11fb148ef0e964d1e3c447270fcfe886.jpg saved to cache
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_7bea92de145b6401737b6987a04a6a3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_7bea92de145b6401737b6987a04a6a3a.jpg not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_b739b578733925df700226aaa7771e1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_b739b578733925df700226aaa7771e1e.jpg not downloaded yet
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_3dbb3699a505f0b9284e146f17350296.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_3554060d509efa92965e04e49da56564.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_3554060d509efa92965e04e49da56564.jpg not downloaded yet
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_e88ec220cb0552fa515880b40cd2ef4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58a05d0>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_3dbb3699a505f0b9284e146f17350296.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_3dbb3699a505f0b9284e146f17350296.jpg saved to cache
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_359b9ddb86b964d5e866d8a3e9b60b4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD15587> (referer: https://www.auto1.com/v1/car-details-view/HD15587/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ff410>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_e88ec220cb0552fa515880b40cd2ef4c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_e88ec220cb0552fa515880b40cd2ef4c.jpg saved to cache
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_e2fb04e09fd9a9b2d566d64360354f84.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a18d0>
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_359b9ddb86b964d5e866d8a3e9b60b4b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_359b9ddb86b964d5e866d8a3e9b60b4b.jpg saved to cache
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587
2026-03-28 11:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with scrape type 1
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c53ce88e-9e36-59fa-add6-f0db42bbb7d7
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_f4c6d9f2475c8f2aa090bbba0626105e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_f4c6d9f2475c8f2aa090bbba0626105e.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_781eba97f146b9d4fc1f4771a75fd699.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_781eba97f146b9d4fc1f4771a75fd699.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_701f8d41b79bd124e2e5f17b9f5165fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_701f8d41b79bd124e2e5f17b9f5165fe.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_d1a8d6be32ed9a460074c65e08899477.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_d1a8d6be32ed9a460074c65e08899477.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_c8c6b32aef556ff766ec4b79ed7ee16a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_c8c6b32aef556ff766ec4b79ed7ee16a.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_7bf78b7e08f763e3ba996dd045d5cebd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_7bf78b7e08f763e3ba996dd045d5cebd.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_206cdce2700f4be064c22d180306f4f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_206cdce2700f4be064c22d180306f4f2.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_9e573159faf4c97972b8bfc96d9dde11.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_9e573159faf4c97972b8bfc96d9dde11.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_21955ae4a13d671f7093d0365ed9b35a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_21955ae4a13d671f7093d0365ed9b35a.jpg already downloaded
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5a%252F9c5ab612352dfd4e84358ec61121773c%252Fpa%252FHD15587_a2aa5625d1c75ac16e47173e27185bdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_a2aa5625d1c75ac16e47173e27185bdc.jpg already downloaded
2026-03-28 11:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c53ce88e-9e36-59fa-add6-f0db42bbb7d7, identifier: HD15587
2026-03-28 11:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587
2026-03-28 11:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587
2026-03-28 11:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587 to the API
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HD15587>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:38:37Z',
 'fuel_type': 'petrol',
 'id': 'c53ce88e-9e36-59fa-add6-f0db42bbb7d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD15587',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 68537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_f4c6d9f2475c8f2aa090bbba0626105e.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_781eba97f146b9d4fc1f4771a75fd699.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_701f8d41b79bd124e2e5f17b9f5165fe.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_d1a8d6be32ed9a460074c65e08899477.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_c8c6b32aef556ff766ec4b79ed7ee16a.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_7bf78b7e08f763e3ba996dd045d5cebd.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_206cdce2700f4be064c22d180306f4f2.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_9e573159faf4c97972b8bfc96d9dde11.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_21955ae4a13d671f7093d0365ed9b35a.jpg',
                'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_a2aa5625d1c75ac16e47173e27185bdc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_f4c6d9f2475c8f2aa090bbba0626105e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_781eba97f146b9d4fc1f4771a75fd699.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_701f8d41b79bd124e2e5f17b9f5165fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_d1a8d6be32ed9a460074c65e08899477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_c8c6b32aef556ff766ec4b79ed7ee16a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_7bf78b7e08f763e3ba996dd045d5cebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_206cdce2700f4be064c22d180306f4f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_9e573159faf4c97972b8bfc96d9dde11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_21955ae4a13d671f7093d0365ed9b35a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53ce88e-9e36-59fa-add6-f0db42bbb7d7/c53ce88e-9e36-59fa-add6-f0db42bbb7d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5a/9c5ab612352dfd4e84358ec61121773c/pa/HD15587_a2aa5625d1c75ac16e47173e27185bdc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD15587%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [auto1.es] INFO: Saving data for HD15587: {'created_time': 1774695971.695406, 'last_price_update_time': 1774695971.695415, 'auction_closing_time': 1774885117.0}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HD15587') HTTP/1.1" 204 0
2026-03-28 11:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_f782a5e36c60e5c1c7cf5bcd238ba677.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP09547> (referer: https://www.auto1.com/v1/car-details-view/FP09547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8359250>
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_e2fb04e09fd9a9b2d566d64360354f84.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_e2fb04e09fd9a9b2d566d64360354f84.jpg saved to cache
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_7bea92de145b6401737b6987a04a6a3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6424310>
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_f782a5e36c60e5c1c7cf5bcd238ba677.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_f782a5e36c60e5c1c7cf5bcd238ba677.jpg saved to cache
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fd0eca-7750-564a-816a-622c07287b91 with identifier: FP09547
2026-03-28 11:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fd0eca-7750-564a-816a-622c07287b91 with scrape type 1
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg not downloaded yet
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_41b1f73a23fa47afa9752ffc54e141af.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_41b1f73a23fa47afa9752ffc54e141af.jpg not downloaded yet
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_558720a40287278addb85ba1fc017f0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_558720a40287278addb85ba1fc017f0f.jpg not downloaded yet
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6348a90>
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_7bea92de145b6401737b6987a04a6a3a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_7bea92de145b6401737b6987a04a6a3a.jpg saved to cache
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_59d91a9392264c1d127f3f1c36c3b7f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_59d91a9392264c1d127f3f1c36c3b7f0.jpg not downloaded yet
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_a12d09d1a34b1f570d085695fc85b9cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_a12d09d1a34b1f570d085695fc85b9cb.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_701dbfaa9b22da4d8e0619bd17c0d29e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_701dbfaa9b22da4d8e0619bd17c0d29e.jpg not downloaded yet
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV46161> (referer: https://www.auto1.com/v1/car-details-view/RV46161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_3554060d509efa92965e04e49da56564.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c9bca4-f6e4-5327-a7d5-a5750f66ebda with identifier: RV46161
2026-03-28 11:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda with scrape type 1
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_58b3ef1322b474c10c34991a33d30214.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_58b3ef1322b474c10c34991a33d30214.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_a9c26491deef21ee5e6f7f07de4d87aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_a9c26491deef21ee5e6f7f07de4d87aa.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_9e051ffdfada08b9bb0e128fbc3e3066.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_9e051ffdfada08b9bb0e128fbc3e3066.jpg not downloaded yet
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58f07d0>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_3554060d509efa92965e04e49da56564.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_3554060d509efa92965e04e49da56564.jpg saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_e1df2f647f2e6375be52924373730dfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_e1df2f647f2e6375be52924373730dfa.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_c10ee24900716525c2782d0375e67acf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_c10ee24900716525c2782d0375e67acf.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_28765b3b1337523687214d17193fb7e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_28765b3b1337523687214d17193fb7e0.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_fdad3b4df9e0b94d5db6354d9f8da9d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_fdad3b4df9e0b94d5db6354d9f8da9d5.jpg not downloaded yet
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_b739b578733925df700226aaa7771e1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_d219c62ebc56d3d01133e57e44c5b1ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_d219c62ebc56d3d01133e57e44c5b1ed.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_3595d858bec8935d3bab67ac7f12a824.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_3595d858bec8935d3bab67ac7f12a824.jpg not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_969e6a4f164fbfe8bb9ac3fbc0970f83.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_969e6a4f164fbfe8bb9ac3fbc0970f83.jpg not downloaded yet
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f647cc10>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_b739b578733925df700226aaa7771e1e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_b739b578733925df700226aaa7771e1e.jpg saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_7b4d17ca3f729503a277c9237daa45ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_bdaa0f7e1719ae1b2c896849421c1321.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64958d0>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_7b4d17ca3f729503a277c9237daa45ac.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_7b4d17ca3f729503a277c9237daa45ac.jpg saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_a2f8bcff5dbce26cda67ce8386403157.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6395f90>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_bdaa0f7e1719ae1b2c896849421c1321.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_bdaa0f7e1719ae1b2c896849421c1321.jpg saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_4161db930829b858506bef387b26a7ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6495c90>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_a2f8bcff5dbce26cda67ce8386403157.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_a2f8bcff5dbce26cda67ce8386403157.jpg saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58a0fd0>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_4161db930829b858506bef387b26a7ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_4161db930829b858506bef387b26a7ff.jpg saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_51fe077990687627e2b7e38b550f37fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62e6190>
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_51fe077990687627e2b7e38b550f37fd.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_51fe077990687627e2b7e38b550f37fd.jpg saved to cache
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_701dbfaa9b22da4d8e0619bd17c0d29e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c6590>
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_701dbfaa9b22da4d8e0619bd17c0d29e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_701dbfaa9b22da4d8e0619bd17c0d29e.jpg saved to cache
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_a12d09d1a34b1f570d085695fc85b9cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6495e50>
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_a12d09d1a34b1f570d085695fc85b9cb.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_a12d09d1a34b1f570d085695fc85b9cb.jpg saved to cache
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_fdad3b4df9e0b94d5db6354d9f8da9d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59ae7d0>
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_fdad3b4df9e0b94d5db6354d9f8da9d5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_fdad3b4df9e0b94d5db6354d9f8da9d5.jpg saved to cache
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_969e6a4f164fbfe8bb9ac3fbc0970f83.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a6d10>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_969e6a4f164fbfe8bb9ac3fbc0970f83.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_969e6a4f164fbfe8bb9ac3fbc0970f83.jpg saved to cache
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_3595d858bec8935d3bab67ac7f12a824.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6395b90>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_3595d858bec8935d3bab67ac7f12a824.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_3595d858bec8935d3bab67ac7f12a824.jpg saved to cache
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_d219c62ebc56d3d01133e57e44c5b1ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6351ed0>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_d219c62ebc56d3d01133e57e44c5b1ed.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_d219c62ebc56d3d01133e57e44c5b1ed.jpg saved to cache
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_28765b3b1337523687214d17193fb7e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58f0a90>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_28765b3b1337523687214d17193fb7e0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_28765b3b1337523687214d17193fb7e0.jpg saved to cache
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_c10ee24900716525c2782d0375e67acf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_e1df2f647f2e6375be52924373730dfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59ae7d0>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_c10ee24900716525c2782d0375e67acf.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_c10ee24900716525c2782d0375e67acf.jpg saved to cache
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_9e051ffdfada08b9bb0e128fbc3e3066.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5933b10>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_e1df2f647f2e6375be52924373730dfa.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_e1df2f647f2e6375be52924373730dfa.jpg saved to cache
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_a9c26491deef21ee5e6f7f07de4d87aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_58b3ef1322b474c10c34991a33d30214.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6424310>
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_9e051ffdfada08b9bb0e128fbc3e3066.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_9e051ffdfada08b9bb0e128fbc3e3066.jpg saved to cache
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f643d650>
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_a9c26491deef21ee5e6f7f07de4d87aa.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_a9c26491deef21ee5e6f7f07de4d87aa.jpg saved to cache
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63a2190>
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fa8%252Ffda8cfa4be4e400077fb89e103944416%252Fpa%252FRV46161_58b3ef1322b474c10c34991a33d30214.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_58b3ef1322b474c10c34991a33d30214.jpg saved to cache
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda
2026-03-28 11:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63c9bca4-f6e4-5327-a7d5-a5750f66ebda, skipping ID generation
2026-03-28 11:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda with scrape type 1
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63c9bca4-f6e4-5327-a7d5-a5750f66ebda sending to next pipeline
2026-03-28 11:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 63c9bca4-f6e4-5327-a7d5-a5750f66ebda, identifier: RV46161
2026-03-28 11:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 63c9bca4-f6e4-5327-a7d5-a5750f66ebda with identifier: RV46161
2026-03-28 11:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 63c9bca4-f6e4-5327-a7d5-a5750f66ebda with identifier: RV46161
2026-03-28 11:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 63c9bca4-f6e4-5327-a7d5-a5750f66ebda with identifier: RV46161 to the API
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_58b3ef1322b474c10c34991a33d30214.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:47:39Z',
 'fuel_type': 'diesel',
 'id': '63c9bca4-f6e4-5327-a7d5-a5750f66ebda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV46161',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 152395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_58b3ef1322b474c10c34991a33d30214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_a9c26491deef21ee5e6f7f07de4d87aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_9e051ffdfada08b9bb0e128fbc3e3066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_e1df2f647f2e6375be52924373730dfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_c10ee24900716525c2782d0375e67acf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_28765b3b1337523687214d17193fb7e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_fdad3b4df9e0b94d5db6354d9f8da9d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_d219c62ebc56d3d01133e57e44c5b1ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_3595d858bec8935d3bab67ac7f12a824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c9bca4-f6e4-5327-a7d5-a5750f66ebda/63c9bca4-f6e4-5327-a7d5-a5750f66ebda_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a8/fda8cfa4be4e400077fb89e103944416/pa/RV46161_969e6a4f164fbfe8bb9ac3fbc0970f83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV46161%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [auto1.es] INFO: Saving data for RV46161: {'created_time': 1774695976.07666, 'last_price_update_time': 1774695976.07667, 'auction_closing_time': 1774885659.0}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV46161') HTTP/1.1" 204 0
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_59d91a9392264c1d127f3f1c36c3b7f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f643d990>
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_59d91a9392264c1d127f3f1c36c3b7f0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_59d91a9392264c1d127f3f1c36c3b7f0.jpg saved to cache
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_558720a40287278addb85ba1fc017f0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62e6a90>
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_558720a40287278addb85ba1fc017f0f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_558720a40287278addb85ba1fc017f0f.jpg saved to cache
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_41b1f73a23fa47afa9752ffc54e141af.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58a1250>
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_41b1f73a23fa47afa9752ffc54e141af.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_41b1f73a23fa47afa9752ffc54e141af.jpg saved to cache
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_88f0327e494aaa9e55a25c613f4b3df1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62ae650>
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F39%252F3f3988f7986416f04eed784c53e9bd9c%252Fpa%252FFP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg saved to cache
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40fd0eca-7750-564a-816a-622c07287b91
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40fd0eca-7750-564a-816a-622c07287b91, skipping ID generation
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fd0eca-7750-564a-816a-622c07287b91 with scrape type 1
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40fd0eca-7750-564a-816a-622c07287b91 sending to next pipeline
2026-03-28 11:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40fd0eca-7750-564a-816a-622c07287b91, identifier: FP09547
2026-03-28 11:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40fd0eca-7750-564a-816a-622c07287b91 with identifier: FP09547
2026-03-28 11:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40fd0eca-7750-564a-816a-622c07287b91 with identifier: FP09547
2026-03-28 11:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40fd0eca-7750-564a-816a-622c07287b91 with identifier: FP09547 to the API
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:36Z',
 'fuel_type': 'diesel',
 'id': '40fd0eca-7750-564a-816a-622c07287b91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP09547',
 'listing': 'auction',
 'location': 'ES, San Juan de Aznalfarache, Sevilla',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 281463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_efc62ed6bd0f7b39dae161fe58eb59b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_41b1f73a23fa47afa9752ffc54e141af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_558720a40287278addb85ba1fc017f0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_59d91a9392264c1d127f3f1c36c3b7f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_a12d09d1a34b1f570d085695fc85b9cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fd0eca-7750-564a-816a-622c07287b91/40fd0eca-7750-564a-816a-622c07287b91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/39/3f3988f7986416f04eed784c53e9bd9c/pa/FP09547_701dbfaa9b22da4d8e0619bd17c0d29e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP09547%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [auto1.es] INFO: Saving data for FP09547: {'created_time': 1774695977.436759, 'last_price_update_time': 1774695977.436771, 'auction_closing_time': 1774883376.0}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FP09547') HTTP/1.1" 204 0
2026-03-28 11:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_fedacd0bec4eec9f0792f9e1735b80aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f86a9c50>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_88f0327e494aaa9e55a25c613f4b3df1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_88f0327e494aaa9e55a25c613f4b3df1.jpg saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638c490>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_fedacd0bec4eec9f0792f9e1735b80aa.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_fedacd0bec4eec9f0792f9e1735b80aa.jpg saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_906e9974741b105c3804757a74f53296.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_e81b13051e070f76350abe3bfd17f919.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6348710>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fca%252F0cca667b0d649a39350eeebc5c1dd64e%252Fpa%252FYS26400_906e9974741b105c3804757a74f53296.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_906e9974741b105c3804757a74f53296.jpg saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b833916-c9c6-5d91-89b7-e43b02517a4d
2026-03-28 11:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b833916-c9c6-5d91-89b7-e43b02517a4d, skipping ID generation
2026-03-28 11:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b833916-c9c6-5d91-89b7-e43b02517a4d with scrape type 1
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b833916-c9c6-5d91-89b7-e43b02517a4d sending to next pipeline
2026-03-28 11:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b833916-c9c6-5d91-89b7-e43b02517a4d, identifier: YS26400
2026-03-28 11:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b833916-c9c6-5d91-89b7-e43b02517a4d with identifier: YS26400
2026-03-28 11:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b833916-c9c6-5d91-89b7-e43b02517a4d with identifier: YS26400
2026-03-28 11:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b833916-c9c6-5d91-89b7-e43b02517a4d with identifier: YS26400 to the API
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_906e9974741b105c3804757a74f53296.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:04:20Z',
 'fuel_type': 'diesel',
 'id': '2b833916-c9c6-5d91-89b7-e43b02517a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS26400',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 306041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_906e9974741b105c3804757a74f53296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_51fe077990687627e2b7e38b550f37fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_a2f8bcff5dbce26cda67ce8386403157.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_7b4d17ca3f729503a277c9237daa45ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_b739b578733925df700226aaa7771e1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b833916-c9c6-5d91-89b7-e43b02517a4d/2b833916-c9c6-5d91-89b7-e43b02517a4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ca/0cca667b0d649a39350eeebc5c1dd64e/pa/YS26400_3554060d509efa92965e04e49da56564.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2011}
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS26400%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [auto1.es] INFO: Saving data for YS26400: {'created_time': 1774695978.233274, 'last_price_update_time': 1774695978.233287, 'auction_closing_time': 1774883060.0}
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YS26400') HTTP/1.1" 204 0
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_2a5eb993c1fae86ab941844e06db7dfe.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59a0f10>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_e81b13051e070f76350abe3bfd17f919.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_e81b13051e070f76350abe3bfd17f919.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6427f10>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_2a5eb993c1fae86ab941844e06db7dfe.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_2a5eb993c1fae86ab941844e06db7dfe.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_df52ab2628c243d8c88b141541cbe3bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_d4b261ab2865fff9b60ade121378b4de.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f643e550>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_df52ab2628c243d8c88b141541cbe3bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_df52ab2628c243d8c88b141541cbe3bd.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_0e9a73174a45a6394744e5a7f0f91b85.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62e5110>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_d4b261ab2865fff9b60ade121378b4de.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_d4b261ab2865fff9b60ade121378b4de.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_8ded96f1cf5476a45cd37b61c8b22ea2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f591d110>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_0e9a73174a45a6394744e5a7f0f91b85.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_0e9a73174a45a6394744e5a7f0f91b85.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_c5eb70c7cb42917f617230b933f68aa9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6349d90>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_8ded96f1cf5476a45cd37b61c8b22ea2.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_8ded96f1cf5476a45cd37b61c8b22ea2.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_17d0a462840ffdc337cbff536ecc6125.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6395f90>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_c5eb70c7cb42917f617230b933f68aa9.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_c5eb70c7cb42917f617230b933f68aa9.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_75e591fcc3f9f1311a3e3c11c42eff95.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82eb390>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_17d0a462840ffdc337cbff536ecc6125.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_17d0a462840ffdc337cbff536ecc6125.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_3879149b2fd9d82684950f710ab33763.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f634b390>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_75e591fcc3f9f1311a3e3c11c42eff95.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_75e591fcc3f9f1311a3e3c11c42eff95.jpg saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_5e288c3acaab7ab489f1182df860a38e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59422d0>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fea%252F9bea0a6ed19b4a314335ea11af7eb215%252Fpa%252FBB43424_3879149b2fd9d82684950f710ab33763.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_3879149b2fd9d82684950f710ab33763.jpg saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3501197-aa1b-5c6c-b8b0-4e96ccccc549, skipping ID generation
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549 with scrape type 1
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3501197-aa1b-5c6c-b8b0-4e96ccccc549 sending to next pipeline
2026-03-28 11:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3501197-aa1b-5c6c-b8b0-4e96ccccc549, identifier: BB43424
2026-03-28 11:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3501197-aa1b-5c6c-b8b0-4e96ccccc549 with identifier: BB43424
2026-03-28 11:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3501197-aa1b-5c6c-b8b0-4e96ccccc549 with identifier: BB43424
2026-03-28 11:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3501197-aa1b-5c6c-b8b0-4e96ccccc549 with identifier: BB43424 to the API
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_3879149b2fd9d82684950f710ab33763.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:11:12Z',
 'fuel_type': 'petrol',
 'id': 'e3501197-aa1b-5c6c-b8b0-4e96ccccc549',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB43424',
 'listing': 'auction',
 'location': 'ES, Valladolid',
 'make': 'BMW',
 'model': '6er',
 'odometer': 119065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_3879149b2fd9d82684950f710ab33763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_e2fb04e09fd9a9b2d566d64360354f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_c5eb70c7cb42917f617230b933f68aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_0e9a73174a45a6394744e5a7f0f91b85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_df52ab2628c243d8c88b141541cbe3bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_2a5eb993c1fae86ab941844e06db7dfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_fedacd0bec4eec9f0792f9e1735b80aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_4161db930829b858506bef387b26a7ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_bdaa0f7e1719ae1b2c896849421c1321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3501197-aa1b-5c6c-b8b0-4e96ccccc549/e3501197-aa1b-5c6c-b8b0-4e96ccccc549_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ea/9bea0a6ed19b4a314335ea11af7eb215/pa/BB43424_7bea92de145b6401737b6987a04a6a3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 6er 630i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB43424%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [auto1.es] INFO: Saving data for BB43424: {'created_time': 1774695979.529475, 'last_price_update_time': 1774695979.529485, 'auction_closing_time': 1774883472.0}
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB43424') HTTP/1.1" 204 0
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_099d0a443275f44501a6dfdf8e0fed3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB49696> (referer: https://www.auto1.com/v1/car-details-view/HB49696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG10975> (referer: https://www.auto1.com/v1/car-details-view/VG10975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f634b390>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_5e288c3acaab7ab489f1182df860a38e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_5e288c3acaab7ab489f1182df860a38e.jpg saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_33930775d303e7a8085065cf516c04dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f591c690>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_099d0a443275f44501a6dfdf8e0fed3e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_099d0a443275f44501a6dfdf8e0fed3e.jpg saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb00534-c448-535c-9322-02c3699f4a5c with identifier: HB49696
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb00534-c448-535c-9322-02c3699f4a5c with scrape type 1
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_0313c060d156f4a39b1a8ffa645df608.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_0313c060d156f4a39b1a8ffa645df608.jpg not downloaded yet
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7037c6-ee18-5c99-a6fc-7bca839cacda with identifier: VG10975
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda with scrape type 1
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_bfaa9da4a29103c15c029cf782f70abe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_bfaa9da4a29103c15c029cf782f70abe.jpg not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_c8384c86c20d90e866b0f3223cff910d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_c8384c86c20d90e866b0f3223cff910d.jpg not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg not downloaded yet
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_f404d84b782b46818a1edb2389f5a47b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_6710c1a923ef70bcb0c214f25e8727f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_6710c1a923ef70bcb0c214f25e8727f2.jpg not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_0905ca42591bd0b6a8e7ddf2fc458a50.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_0905ca42591bd0b6a8e7ddf2fc458a50.jpg not downloaded yet
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e7550>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F98%252F7b985220aded5a2ef0b80e37cb32b1e4%252Fpa%252FMH61134_33930775d303e7a8085065cf516c04dc.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_33930775d303e7a8085065cf516c04dc.jpg saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 230f32e4-d2de-5e50-a895-45784111aab5
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 230f32e4-d2de-5e50-a895-45784111aab5, skipping ID generation
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230f32e4-d2de-5e50-a895-45784111aab5 with scrape type 1
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 230f32e4-d2de-5e50-a895-45784111aab5 sending to next pipeline
2026-03-28 11:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 230f32e4-d2de-5e50-a895-45784111aab5, identifier: MH61134
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_589d4cef9bd898bf44ce25d616342463.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_589d4cef9bd898bf44ce25d616342463.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_554a8949e9804eace8f44712ba309dd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_554a8949e9804eace8f44712ba309dd5.jpg not downloaded yet
2026-03-28 11:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 230f32e4-d2de-5e50-a895-45784111aab5 with identifier: MH61134
2026-03-28 11:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 230f32e4-d2de-5e50-a895-45784111aab5 with identifier: MH61134
2026-03-28 11:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 230f32e4-d2de-5e50-a895-45784111aab5 with identifier: MH61134 to the API
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_33930775d303e7a8085065cf516c04dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:20Z',
 'fuel_type': 'diesel',
 'id': '230f32e4-d2de-5e50-a895-45784111aab5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH61134',
 'listing': 'auction',
 'location': 'ES, Cáceres',
 'make': 'BMW',
 'model': '3er',
 'odometer': 60064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_33930775d303e7a8085065cf516c04dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_099d0a443275f44501a6dfdf8e0fed3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_5e288c3acaab7ab489f1182df860a38e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_75e591fcc3f9f1311a3e3c11c42eff95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_17d0a462840ffdc337cbff536ecc6125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_8ded96f1cf5476a45cd37b61c8b22ea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_d4b261ab2865fff9b60ade121378b4de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_f782a5e36c60e5c1c7cf5bcd238ba677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_e81b13051e070f76350abe3bfd17f919.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230f32e4-d2de-5e50-a895-45784111aab5/230f32e4-d2de-5e50-a895-45784111aab5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/98/7b985220aded5a2ef0b80e37cb32b1e4/pa/MH61134_88f0327e494aaa9e55a25c613f4b3df1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH61134%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [auto1.es] INFO: Saving data for MH61134: {'created_time': 1774695980.394137, 'last_price_update_time': 1774695980.394148, 'auction_closing_time': 1774885340.0}
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MH61134') HTTP/1.1" 204 0
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_4e13a828354a31f76600f8ef8d493e9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_fa65dc20cb815a752f23d19576189706.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_fa65dc20cb815a752f23d19576189706.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_6e05640dc2787bedb1a71b3d4ff5c48f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e05640dc2787bedb1a71b3d4ff5c48f.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_7157561f91874ff649fe30aad028a0a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_7157561f91874ff649fe30aad028a0a6.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_acece4934df3a2b055d5b98aabf7a5fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_acece4934df3a2b055d5b98aabf7a5fa.jpg not downloaded yet
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6474c50>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_f404d84b782b46818a1edb2389f5a47b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_f404d84b782b46818a1edb2389f5a47b.jpg saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_bfaa9da4a29103c15c029cf782f70abe.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_4a02b1dad1298a037dfbaf3aa4550a53.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_4a02b1dad1298a037dfbaf3aa4550a53.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_ae773fff75f452d73eb0a6db36246ec1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_ae773fff75f452d73eb0a6db36246ec1.jpg not downloaded yet
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU62533> (referer: https://www.auto1.com/v1/car-details-view/KU62533/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_62b9ffac0eef7cfef38bc227d1f66719.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_62b9ffac0eef7cfef38bc227d1f66719.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_6e573d2c53dcdfb45d2854edc07b4135.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e573d2c53dcdfb45d2854edc07b4135.jpg not downloaded yet
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB85500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59b4590>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F02%252Fa90272c4b0670e25306ee78ded5c781d%252Fpa%252FVT22035_4e13a828354a31f76600f8ef8d493e9e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_4e13a828354a31f76600f8ef8d493e9e.jpg saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656
2026-03-28 11:06:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1549ea02-6e9b-55fc-95a9-d7ac93c69656, skipping ID generation
2026-03-28 11:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656 with scrape type 1
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1549ea02-6e9b-55fc-95a9-d7ac93c69656 sending to next pipeline
2026-03-28 11:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1549ea02-6e9b-55fc-95a9-d7ac93c69656, identifier: VT22035
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_ea7640b51b06d51d08015209a0cfb98f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_ea7640b51b06d51d08015209a0cfb98f.jpg not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_89db124af7a8627e9b8a57f54ffc487b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_89db124af7a8627e9b8a57f54ffc487b.jpg not downloaded yet
2026-03-28 11:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1549ea02-6e9b-55fc-95a9-d7ac93c69656 with identifier: VT22035
2026-03-28 11:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1549ea02-6e9b-55fc-95a9-d7ac93c69656 with identifier: VT22035
2026-03-28 11:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1549ea02-6e9b-55fc-95a9-d7ac93c69656 with identifier: VT22035 to the API
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_4e13a828354a31f76600f8ef8d493e9e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:00:13Z',
 'fuel_type': 'petrol',
 'id': '1549ea02-6e9b-55fc-95a9-d7ac93c69656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT22035',
 'listing': 'auction',
 'location': 'ES, Almería',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 106253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_4e13a828354a31f76600f8ef8d493e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_f404d84b782b46818a1edb2389f5a47b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_359b9ddb86b964d5e866d8a3e9b60b4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_e88ec220cb0552fa515880b40cd2ef4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_3dbb3699a505f0b9284e146f17350296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1549ea02-6e9b-55fc-95a9-d7ac93c69656/1549ea02-6e9b-55fc-95a9-d7ac93c69656_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/02/a90272c4b0670e25306ee78ded5c781d/pa/VT22035_11fb148ef0e964d1e3c447270fcfe886.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Community',
 'transmission': 'manual',
 'trim': 'Community',
 'year': 2005}
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT22035%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [auto1.es] INFO: Saving data for VT22035: {'created_time': 1774695981.137491, 'last_price_update_time': 1774695981.137501, 'auction_closing_time': 1774882813.0}
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT22035') HTTP/1.1" 204 0
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS14149/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_0905ca42591bd0b6a8e7ddf2fc458a50.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_658fb6fc81364317c804dc7b4e5ac4c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_658fb6fc81364317c804dc7b4e5ac4c8.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_a3703d99def746bc11faa0d26d904c8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_a3703d99def746bc11faa0d26d904c8d.jpg not downloaded yet
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR52438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE06656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62af950>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_bfaa9da4a29103c15c029cf782f70abe.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_bfaa9da4a29103c15c029cf782f70abe.jpg saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa with identifier: KU62533
2026-03-28 11:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa with scrape type 1
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_8789ea8714d129e8f2d350125a5359f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8789ea8714d129e8f2d350125a5359f9.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_3a95824cbb3b2b9e87f7a90dae844f1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_3a95824cbb3b2b9e87f7a90dae844f1b.jpg not downloaded yet
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR47021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_f32013f031eb6be72627bec216f51404.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_f32013f031eb6be72627bec216f51404.jpg not downloaded yet
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f595a090>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_0905ca42591bd0b6a8e7ddf2fc458a50.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_0905ca42591bd0b6a8e7ddf2fc458a50.jpg saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_acece4934df3a2b055d5b98aabf7a5fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_b232490bbd5515b783d0028ecc70b523.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_b232490bbd5515b783d0028ecc70b523.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_ea65989534bf01b42249f5501b13c2d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_ea65989534bf01b42249f5501b13c2d6.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_6a53be1cb724ad3e9cee16f13ca94401.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_6a53be1cb724ad3e9cee16f13ca94401.jpg not downloaded yet
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59b7150>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_acece4934df3a2b055d5b98aabf7a5fa.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_acece4934df3a2b055d5b98aabf7a5fa.jpg saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_16e0021807b529acd2c66d9029154e86.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_16e0021807b529acd2c66d9029154e86.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_8e54536e98d91184f3b01641d90dfa29.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8e54536e98d91184f3b01641d90dfa29.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_9a5b70ade79c34a28e25c31d12551667.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_9a5b70ade79c34a28e25c31d12551667.jpg not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_646b072bb001578cc1a8c926d9fc1502.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_646b072bb001578cc1a8c926d9fc1502.jpg not downloaded yet
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_7157561f91874ff649fe30aad028a0a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e573d2c53dcdfb45d2854edc07b4135.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638ed50>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_7157561f91874ff649fe30aad028a0a6.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_7157561f91874ff649fe30aad028a0a6.jpg saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_89db124af7a8627e9b8a57f54ffc487b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6450190>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_6e573d2c53dcdfb45d2854edc07b4135.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e573d2c53dcdfb45d2854edc07b4135.jpg saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_ea7640b51b06d51d08015209a0cfb98f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f637ed50>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_89db124af7a8627e9b8a57f54ffc487b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_89db124af7a8627e9b8a57f54ffc487b.jpg saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_a3703d99def746bc11faa0d26d904c8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5939450>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_ea7640b51b06d51d08015209a0cfb98f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_ea7640b51b06d51d08015209a0cfb98f.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63f9410>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_a3703d99def746bc11faa0d26d904c8d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_a3703d99def746bc11faa0d26d904c8d.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_658fb6fc81364317c804dc7b4e5ac4c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85dd410>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_658fb6fc81364317c804dc7b4e5ac4c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_658fb6fc81364317c804dc7b4e5ac4c8.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_3a95824cbb3b2b9e87f7a90dae844f1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_f32013f031eb6be72627bec216f51404.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f593b190>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_3a95824cbb3b2b9e87f7a90dae844f1b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_3a95824cbb3b2b9e87f7a90dae844f1b.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63fa090>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_f32013f031eb6be72627bec216f51404.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_f32013f031eb6be72627bec216f51404.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_646b072bb001578cc1a8c926d9fc1502.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f650b150>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_646b072bb001578cc1a8c926d9fc1502.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_646b072bb001578cc1a8c926d9fc1502.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_9a5b70ade79c34a28e25c31d12551667.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6405590>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_9a5b70ade79c34a28e25c31d12551667.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_9a5b70ade79c34a28e25c31d12551667.jpg saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8e54536e98d91184f3b01641d90dfa29.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR47021> (referer: https://www.auto1.com/v1/car-details-view/YR47021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f637f450>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_8e54536e98d91184f3b01641d90dfa29.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8e54536e98d91184f3b01641d90dfa29.jpg saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cb3c552-cad9-5af7-8006-6172f0435989 with identifier: YR47021
2026-03-28 11:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cb3c552-cad9-5af7-8006-6172f0435989 with scrape type 1
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_199c24d44783a114245bc0a24b678b04.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_199c24d44783a114245bc0a24b678b04.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_a397dd4b133124fda84a05de97445aaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_a397dd4b133124fda84a05de97445aaf.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_d611ce82591943fb8f38af6654a93be6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_d611ce82591943fb8f38af6654a93be6.jpg not downloaded yet
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_16e0021807b529acd2c66d9029154e86.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_7939c319c369c22534701e3164c15dac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7939c319c369c22534701e3164c15dac.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_bf1d82c806b3cb1531858563c0aacafa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_bf1d82c806b3cb1531858563c0aacafa.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_7e576a18513e52974dba993d0a8339e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7e576a18513e52974dba993d0a8339e9.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_db1811043582efb57a67bad0cf63bc0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_db1811043582efb57a67bad0cf63bc0d.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_7a12ba082abbf2c49a0e8a42d613bab5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7a12ba082abbf2c49a0e8a42d613bab5.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_59ccaae0e57155eda27bcd4d1ccb1988.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_59ccaae0e57155eda27bcd4d1ccb1988.jpg not downloaded yet
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_fbdd830d398175fd6bd9a16b2e383358.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_fbdd830d398175fd6bd9a16b2e383358.jpg not downloaded yet
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f652a350>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_16e0021807b529acd2c66d9029154e86.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_16e0021807b529acd2c66d9029154e86.jpg saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE06656> (referer: https://www.auto1.com/v1/car-details-view/BE06656/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_6a53be1cb724ad3e9cee16f13ca94401.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_ea65989534bf01b42249f5501b13c2d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656
2026-03-28 11:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fbfa0c-316f-5651-a579-20ee7657b3c5 with scrape type 1
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78fbfa0c-316f-5651-a579-20ee7657b3c5
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_c0b144c158fef96bcdf12fb9245f650a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_c0b144c158fef96bcdf12fb9245f650a.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_16049af3955985983723127da91418e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_16049af3955985983723127da91418e0.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_3e624da933ed3e41a116ea42e6a85568.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_3e624da933ed3e41a116ea42e6a85568.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_d4fb130bee54585b3d56498b22820507.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_d4fb130bee54585b3d56498b22820507.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_39b2ebacd41def75bb64fc0753c67cce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_39b2ebacd41def75bb64fc0753c67cce.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_97b5d6cb41c7af6654386db2c6d4c34d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_97b5d6cb41c7af6654386db2c6d4c34d.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_0cd2ba3b0bbb50cf20bc8cb616f0e128.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_0cd2ba3b0bbb50cf20bc8cb616f0e128.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_244f164f9dbcd77d9dee9d25906b4c6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_244f164f9dbcd77d9dee9d25906b4c6a.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_17464d1145d1732960cfaab756524678.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_17464d1145d1732960cfaab756524678.jpg already downloaded
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Ffd%252F93fdec6408e0186d7449bc24edb1ae27%252Fpa%252FBE06656_466c4a15f1f5871e083a1fec42cddb7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_466c4a15f1f5871e083a1fec42cddb7b.jpg already downloaded
2026-03-28 11:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78fbfa0c-316f-5651-a579-20ee7657b3c5, identifier: BE06656
2026-03-28 11:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656
2026-03-28 11:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656
2026-03-28 11:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656 to the API
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE06656>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'diesel',
 'id': '78fbfa0c-316f-5651-a579-20ee7657b3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE06656',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 170071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_c0b144c158fef96bcdf12fb9245f650a.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_16049af3955985983723127da91418e0.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_3e624da933ed3e41a116ea42e6a85568.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_d4fb130bee54585b3d56498b22820507.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_39b2ebacd41def75bb64fc0753c67cce.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_97b5d6cb41c7af6654386db2c6d4c34d.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_0cd2ba3b0bbb50cf20bc8cb616f0e128.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_244f164f9dbcd77d9dee9d25906b4c6a.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_17464d1145d1732960cfaab756524678.jpg',
                'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_466c4a15f1f5871e083a1fec42cddb7b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_c0b144c158fef96bcdf12fb9245f650a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_16049af3955985983723127da91418e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_3e624da933ed3e41a116ea42e6a85568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_d4fb130bee54585b3d56498b22820507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_39b2ebacd41def75bb64fc0753c67cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_97b5d6cb41c7af6654386db2c6d4c34d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_0cd2ba3b0bbb50cf20bc8cb616f0e128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_244f164f9dbcd77d9dee9d25906b4c6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_17464d1145d1732960cfaab756524678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fbfa0c-316f-5651-a579-20ee7657b3c5/78fbfa0c-316f-5651-a579-20ee7657b3c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/fd/93fdec6408e0186d7449bc24edb1ae27/pa/BE06656_466c4a15f1f5871e083a1fec42cddb7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Diesel Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2016}
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE06656%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [auto1.es] INFO: Saving data for BE06656: {'created_time': 1774695984.29148, 'last_price_update_time': 1774695984.291491, 'auction_closing_time': 1774884938.0}
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE06656') HTTP/1.1" 204 0
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_b232490bbd5515b783d0028ecc70b523.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR52438> (referer: https://www.auto1.com/v1/car-details-view/UR52438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS14149> (referer: https://www.auto1.com/v1/car-details-view/PS14149/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB85500> (referer: https://www.auto1.com/v1/car-details-view/GB85500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6333690>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_6a53be1cb724ad3e9cee16f13ca94401.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_6a53be1cb724ad3e9cee16f13ca94401.jpg saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59593d0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_ea65989534bf01b42249f5501b13c2d6.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_ea65989534bf01b42249f5501b13c2d6.jpg saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64046d0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_b232490bbd5515b783d0028ecc70b523.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_b232490bbd5515b783d0028ecc70b523.jpg saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d4e5bb-840e-5cfe-884b-9f76806f6635 with identifier: UR52438
2026-03-28 11:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d4e5bb-840e-5cfe-884b-9f76806f6635 with scrape type 1
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg not downloaded yet
2026-03-28 11:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f128f80-f8d9-56bb-85a2-581142e539c2 with identifier: PS14149
2026-03-28 11:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f128f80-f8d9-56bb-85a2-581142e539c2 with scrape type 1
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_0ae0e221879e9869629b414a6df40e78.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_0ae0e221879e9869629b414a6df40e78.jpg not downloaded yet
2026-03-28 11:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500
2026-03-28 11:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with scrape type 1
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9ff81bef-daa1-56f5-8d16-a6b84ffb169c
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe3%252Fefe35055719b42c5a42af2c2b1d486b1%252Fpa%252FGB85500_ee387d4c61593d48ad26bdc3a5eb26fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_ee387d4c61593d48ad26bdc3a5eb26fe.jpg already downloaded
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe3%252Fefe35055719b42c5a42af2c2b1d486b1%252Fpa%252FGB85500_7122bda9950e864cbaee86050001d6cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_7122bda9950e864cbaee86050001d6cf.jpg already downloaded
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe3%252Fefe35055719b42c5a42af2c2b1d486b1%252Fpa%252FGB85500_d7ebf2fccbbf7eb0f241207935e779f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_d7ebf2fccbbf7eb0f241207935e779f6.jpg already downloaded
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe3%252Fefe35055719b42c5a42af2c2b1d486b1%252Fpa%252FGB85500_e122252c0b06491d7c985b79be150c9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_e122252c0b06491d7c985b79be150c9c.jpg already downloaded
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe3%252Fefe35055719b42c5a42af2c2b1d486b1%252Fpa%252FGB85500_22c05068e70aefff379dbb55333e587c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_22c05068e70aefff379dbb55333e587c.jpg already downloaded
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe3%252Fefe35055719b42c5a42af2c2b1d486b1%252Fpa%252FGB85500_bb48cbb445d5f0b94bbb2a83b3c55980.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_bb48cbb445d5f0b94bbb2a83b3c55980.jpg already downloaded
2026-03-28 11:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c, identifier: GB85500
2026-03-28 11:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500
2026-03-28 11:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500
2026-03-28 11:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500 to the API
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GB85500>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:57:25Z',
 'fuel_type': 'diesel',
 'id': '9ff81bef-daa1-56f5-8d16-a6b84ffb169c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB85500',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 295147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_ee387d4c61593d48ad26bdc3a5eb26fe.jpg',
                'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_7122bda9950e864cbaee86050001d6cf.jpg',
                'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_d7ebf2fccbbf7eb0f241207935e779f6.jpg',
                'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_e122252c0b06491d7c985b79be150c9c.jpg',
                'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_22c05068e70aefff379dbb55333e587c.jpg',
                'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_bb48cbb445d5f0b94bbb2a83b3c55980.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff81bef-daa1-56f5-8d16-a6b84ffb169c/9ff81bef-daa1-56f5-8d16-a6b84ffb169c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_ee387d4c61593d48ad26bdc3a5eb26fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff81bef-daa1-56f5-8d16-a6b84ffb169c/9ff81bef-daa1-56f5-8d16-a6b84ffb169c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_7122bda9950e864cbaee86050001d6cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff81bef-daa1-56f5-8d16-a6b84ffb169c/9ff81bef-daa1-56f5-8d16-a6b84ffb169c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_d7ebf2fccbbf7eb0f241207935e779f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff81bef-daa1-56f5-8d16-a6b84ffb169c/9ff81bef-daa1-56f5-8d16-a6b84ffb169c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_e122252c0b06491d7c985b79be150c9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff81bef-daa1-56f5-8d16-a6b84ffb169c/9ff81bef-daa1-56f5-8d16-a6b84ffb169c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_22c05068e70aefff379dbb55333e587c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff81bef-daa1-56f5-8d16-a6b84ffb169c/9ff81bef-daa1-56f5-8d16-a6b84ffb169c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e3/efe35055719b42c5a42af2c2b1d486b1/pa/GB85500_bb48cbb445d5f0b94bbb2a83b3c55980.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Arena',
 'transmission': 'manual',
 'trim': 'Arena',
 'year': 2006}
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB85500%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [auto1.es] INFO: Saving data for GB85500: {'created_time': 1774695985.040942, 'last_price_update_time': 1774695985.040952, 'auction_closing_time': 1774886245.0}
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GB85500') HTTP/1.1" 204 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_fe74daf445138e4f498f3f3915adf65a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_fe74daf445138e4f498f3f3915adf65a.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_d611ce82591943fb8f38af6654a93be6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_590ef8f80b7f9a47e73d24f92136faa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_590ef8f80b7f9a47e73d24f92136faa1.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_f63fda92f44b6f2c5b44ddaab0967890.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_f63fda92f44b6f2c5b44ddaab0967890.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_92bd57358fcf0ffa839fdaca6509258c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_92bd57358fcf0ffa839fdaca6509258c.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_b76f4e3a6bc64caf61699a5a26ef62a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_b76f4e3a6bc64caf61699a5a26ef62a1.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_96c91f27907e3bef8e95edb967017382.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_96c91f27907e3bef8e95edb967017382.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_da1b54a602041b5eb284c90ab6cc9842.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_da1b54a602041b5eb284c90ab6cc9842.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_71c1d5eea3cef37b4c55d4fd95f939c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_71c1d5eea3cef37b4c55d4fd95f939c1.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_6376cba1845537a790a61cc3d8de8fce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_6376cba1845537a790a61cc3d8de8fce.jpg not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5958490>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_d611ce82591943fb8f38af6654a93be6.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_d611ce82591943fb8f38af6654a93be6.jpg saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_4f4476e778f1ab09d752f90c4a67c3a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_4f4476e778f1ab09d752f90c4a67c3a1.jpg not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_fbdd830d398175fd6bd9a16b2e383358.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_00c784bcc1695294080f2f072c6aefd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_00c784bcc1695294080f2f072c6aefd0.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_abd00a78ae295f79059bf7dc8f47feed.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_abd00a78ae295f79059bf7dc8f47feed.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_90900fefe8208e1eba3efd0370d99418.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_90900fefe8208e1eba3efd0370d99418.jpg not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e9950>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_fbdd830d398175fd6bd9a16b2e383358.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_fbdd830d398175fd6bd9a16b2e383358.jpg saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_59ccaae0e57155eda27bcd4d1ccb1988.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH42756> (referer: https://www.auto1.com/v1/car-details-view/LH42756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7a12ba082abbf2c49a0e8a42d613bab5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6331e10>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_59ccaae0e57155eda27bcd4d1ccb1988.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_59ccaae0e57155eda27bcd4d1ccb1988.jpg saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_db1811043582efb57a67bad0cf63bc0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15351d91-f4ab-5c32-8464-b2a411c0c24c with identifier: LH42756
2026-03-28 11:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15351d91-f4ab-5c32-8464-b2a411c0c24c with scrape type 1
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_14106ed97e164a2d07c07835d8f477bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_14106ed97e164a2d07c07835d8f477bb.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_4fc3b1f8fb0b5f575cd6b70ccf1dfc38.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_4fc3b1f8fb0b5f575cd6b70ccf1dfc38.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_f3dda965c041b829d0ea8afbe14bf0d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_f3dda965c041b829d0ea8afbe14bf0d1.jpg not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82f3390>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_7a12ba082abbf2c49a0e8a42d613bab5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7a12ba082abbf2c49a0e8a42d613bab5.jpg saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_5887c8b9774bcdd7e70c2942418a8a9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_5887c8b9774bcdd7e70c2942418a8a9d.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_3fe8354fbafbfd5ec6e548b88ddf0dfe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_3fe8354fbafbfd5ec6e548b88ddf0dfe.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_2963ad04559267b3e12f8451cb1e0f3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_2963ad04559267b3e12f8451cb1e0f3d.jpg not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f71e4850>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_db1811043582efb57a67bad0cf63bc0d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_db1811043582efb57a67bad0cf63bc0d.jpg saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_e180a3e0f2ce280c3b45f5c70557afbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_e180a3e0f2ce280c3b45f5c70557afbf.jpg not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7e576a18513e52974dba993d0a8339e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_60451b1043407920776feab04c304ff5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_60451b1043407920776feab04c304ff5.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_c0e9ccaf684fcf36144ab6946a4bfdea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_c0e9ccaf684fcf36144ab6946a4bfdea.jpg not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_b5639750841307ae6ff9e897c42e9a52.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_b5639750841307ae6ff9e897c42e9a52.jpg not downloaded yet
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59eb950>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_7e576a18513e52974dba993d0a8339e9.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7e576a18513e52974dba993d0a8339e9.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_bf1d82c806b3cb1531858563c0aacafa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6476110>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_bf1d82c806b3cb1531858563c0aacafa.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_bf1d82c806b3cb1531858563c0aacafa.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7939c319c369c22534701e3164c15dac.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_0ae0e221879e9869629b414a6df40e78.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_4f4476e778f1ab09d752f90c4a67c3a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6405e90>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_7939c319c369c22534701e3164c15dac.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7939c319c369c22534701e3164c15dac.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6475f50>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_0ae0e221879e9869629b414a6df40e78.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_0ae0e221879e9869629b414a6df40e78.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f631e5d0>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_4f4476e778f1ab09d752f90c4a67c3a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_4f4476e778f1ab09d752f90c4a67c3a1.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_90900fefe8208e1eba3efd0370d99418.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6329910>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_90900fefe8208e1eba3efd0370d99418.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_90900fefe8208e1eba3efd0370d99418.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_abd00a78ae295f79059bf7dc8f47feed.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f646a210>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_abd00a78ae295f79059bf7dc8f47feed.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_abd00a78ae295f79059bf7dc8f47feed.jpg saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_00c784bcc1695294080f2f072c6aefd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_6376cba1845537a790a61cc3d8de8fce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f71e48d0>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_00c784bcc1695294080f2f072c6aefd0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_00c784bcc1695294080f2f072c6aefd0.jpg saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f632a450>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_6376cba1845537a790a61cc3d8de8fce.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_6376cba1845537a790a61cc3d8de8fce.jpg saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_2963ad04559267b3e12f8451cb1e0f3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82a9250>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_2963ad04559267b3e12f8451cb1e0f3d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_2963ad04559267b3e12f8451cb1e0f3d.jpg saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_b5639750841307ae6ff9e897c42e9a52.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f637e750>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_b5639750841307ae6ff9e897c42e9a52.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_b5639750841307ae6ff9e897c42e9a52.jpg saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_c0e9ccaf684fcf36144ab6946a4bfdea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6406b90>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_c0e9ccaf684fcf36144ab6946a4bfdea.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_c0e9ccaf684fcf36144ab6946a4bfdea.jpg saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_60451b1043407920776feab04c304ff5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6519950>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_60451b1043407920776feab04c304ff5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_60451b1043407920776feab04c304ff5.jpg saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_e180a3e0f2ce280c3b45f5c70557afbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6496990>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_e180a3e0f2ce280c3b45f5c70557afbf.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_e180a3e0f2ce280c3b45f5c70557afbf.jpg saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_3fe8354fbafbfd5ec6e548b88ddf0dfe.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59eaad0>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_3fe8354fbafbfd5ec6e548b88ddf0dfe.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_3fe8354fbafbfd5ec6e548b88ddf0dfe.jpg saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_5887c8b9774bcdd7e70c2942418a8a9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_f3dda965c041b829d0ea8afbe14bf0d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630dd90>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_5887c8b9774bcdd7e70c2942418a8a9d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_5887c8b9774bcdd7e70c2942418a8a9d.jpg saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a2fd0>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_f3dda965c041b829d0ea8afbe14bf0d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_f3dda965c041b829d0ea8afbe14bf0d1.jpg saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_4fc3b1f8fb0b5f575cd6b70ccf1dfc38.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_14106ed97e164a2d07c07835d8f477bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5933c90>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_4fc3b1f8fb0b5f575cd6b70ccf1dfc38.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_4fc3b1f8fb0b5f575cd6b70ccf1dfc38.jpg saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6452d50>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F03%252F4a0333afaff5a1a832674596b2f1d964%252Fpa%252FLH42756_14106ed97e164a2d07c07835d8f477bb.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_14106ed97e164a2d07c07835d8f477bb.jpg saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15351d91-f4ab-5c32-8464-b2a411c0c24c
2026-03-28 11:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15351d91-f4ab-5c32-8464-b2a411c0c24c, skipping ID generation
2026-03-28 11:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15351d91-f4ab-5c32-8464-b2a411c0c24c with scrape type 1
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15351d91-f4ab-5c32-8464-b2a411c0c24c sending to next pipeline
2026-03-28 11:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15351d91-f4ab-5c32-8464-b2a411c0c24c, identifier: LH42756
2026-03-28 11:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15351d91-f4ab-5c32-8464-b2a411c0c24c with identifier: LH42756
2026-03-28 11:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15351d91-f4ab-5c32-8464-b2a411c0c24c with identifier: LH42756
2026-03-28 11:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15351d91-f4ab-5c32-8464-b2a411c0c24c with identifier: LH42756 to the API
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_14106ed97e164a2d07c07835d8f477bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:31:34Z',
 'fuel_type': 'petrol',
 'id': '15351d91-f4ab-5c32-8464-b2a411c0c24c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH42756',
 'listing': 'auction',
 'location': 'ES, Xirivella, Valencia.',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 146384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_14106ed97e164a2d07c07835d8f477bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_4fc3b1f8fb0b5f575cd6b70ccf1dfc38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_f3dda965c041b829d0ea8afbe14bf0d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_5887c8b9774bcdd7e70c2942418a8a9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_3fe8354fbafbfd5ec6e548b88ddf0dfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_2963ad04559267b3e12f8451cb1e0f3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_e180a3e0f2ce280c3b45f5c70557afbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_60451b1043407920776feab04c304ff5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_c0e9ccaf684fcf36144ab6946a4bfdea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15351d91-f4ab-5c32-8464-b2a411c0c24c/15351d91-f4ab-5c32-8464-b2a411c0c24c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/03/4a0333afaff5a1a832674596b2f1d964/pa/LH42756_b5639750841307ae6ff9e897c42e9a52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH42756%27 HTTP/1.1" 200 None
2026-03-28 11:06:29 [auto1.es] INFO: Saving data for LH42756: {'created_time': 1774695989.637684, 'last_price_update_time': 1774695989.637693, 'auction_closing_time': 1774884694.0}
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH42756') HTTP/1.1" 204 0
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_71c1d5eea3cef37b4c55d4fd95f939c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f637cfd0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_71c1d5eea3cef37b4c55d4fd95f939c1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_71c1d5eea3cef37b4c55d4fd95f939c1.jpg saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_da1b54a602041b5eb284c90ab6cc9842.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e4c90>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_da1b54a602041b5eb284c90ab6cc9842.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_da1b54a602041b5eb284c90ab6cc9842.jpg saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_96c91f27907e3bef8e95edb967017382.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f631d4d0>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_96c91f27907e3bef8e95edb967017382.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_96c91f27907e3bef8e95edb967017382.jpg saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_b76f4e3a6bc64caf61699a5a26ef62a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e6550>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_b76f4e3a6bc64caf61699a5a26ef62a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_b76f4e3a6bc64caf61699a5a26ef62a1.jpg saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_92bd57358fcf0ffa839fdaca6509258c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_f63fda92f44b6f2c5b44ddaab0967890.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6407810>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_92bd57358fcf0ffa839fdaca6509258c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_92bd57358fcf0ffa839fdaca6509258c.jpg saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638c250>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_f63fda92f44b6f2c5b44ddaab0967890.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_f63fda92f44b6f2c5b44ddaab0967890.jpg saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_590ef8f80b7f9a47e73d24f92136faa1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f652a790>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_590ef8f80b7f9a47e73d24f92136faa1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_590ef8f80b7f9a47e73d24f92136faa1.jpg saved to cache
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f651a390>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F6f%252F556f5cda082692cbd6d7df4ad7195e01%252Fpa%252FPS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg saved to cache
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f128f80-f8d9-56bb-85a2-581142e539c2
2026-03-28 11:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f128f80-f8d9-56bb-85a2-581142e539c2, skipping ID generation
2026-03-28 11:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f128f80-f8d9-56bb-85a2-581142e539c2 with scrape type 1
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f128f80-f8d9-56bb-85a2-581142e539c2 sending to next pipeline
2026-03-28 11:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f128f80-f8d9-56bb-85a2-581142e539c2, identifier: PS14149
2026-03-28 11:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f128f80-f8d9-56bb-85a2-581142e539c2 with identifier: PS14149
2026-03-28 11:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f128f80-f8d9-56bb-85a2-581142e539c2 with identifier: PS14149
2026-03-28 11:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f128f80-f8d9-56bb-85a2-581142e539c2 with identifier: PS14149 to the API
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:29Z',
 'fuel_type': 'diesel',
 'id': '1f128f80-f8d9-56bb-85a2-581142e539c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS14149',
 'listing': 'auction',
 'location': 'ES, Castelló de la Plana',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 239437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_0ae0e221879e9869629b414a6df40e78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_16bb368b20d2c70a2d74ecedc8b62ff5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_f63fda92f44b6f2c5b44ddaab0967890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_b76f4e3a6bc64caf61699a5a26ef62a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_da1b54a602041b5eb284c90ab6cc9842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_6376cba1845537a790a61cc3d8de8fce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_4f4476e778f1ab09d752f90c4a67c3a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_00c784bcc1695294080f2f072c6aefd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_abd00a78ae295f79059bf7dc8f47feed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f128f80-f8d9-56bb-85a2-581142e539c2/1f128f80-f8d9-56bb-85a2-581142e539c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/6f/556f5cda082692cbd6d7df4ad7195e01/pa/PS14149_90900fefe8208e1eba3efd0370d99418.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2012}
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS14149%27 HTTP/1.1" 200 None
2026-03-28 11:06:31 [auto1.es] INFO: Saving data for PS14149: {'created_time': 1774695991.851588, 'last_price_update_time': 1774695991.851598, 'auction_closing_time': 1774886129.0}
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS14149') HTTP/1.1" 204 0
2026-03-28 11:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_fe74daf445138e4f498f3f3915adf65a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59eac10>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_fe74daf445138e4f498f3f3915adf65a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_fe74daf445138e4f498f3f3915adf65a.jpg saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6469c50>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd4%252F7ad4e40995b1ecc529988eb7dc4055ed%252Fpa%252FUR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1d4e5bb-840e-5cfe-884b-9f76806f6635
2026-03-28 11:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1d4e5bb-840e-5cfe-884b-9f76806f6635, skipping ID generation
2026-03-28 11:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d4e5bb-840e-5cfe-884b-9f76806f6635 with scrape type 1
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1d4e5bb-840e-5cfe-884b-9f76806f6635 sending to next pipeline
2026-03-28 11:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1d4e5bb-840e-5cfe-884b-9f76806f6635, identifier: UR52438
2026-03-28 11:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1d4e5bb-840e-5cfe-884b-9f76806f6635 with identifier: UR52438
2026-03-28 11:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1d4e5bb-840e-5cfe-884b-9f76806f6635 with identifier: UR52438
2026-03-28 11:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a1d4e5bb-840e-5cfe-884b-9f76806f6635 with identifier: UR52438 to the API
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:56Z',
 'fuel_type': 'petrol',
 'id': 'a1d4e5bb-840e-5cfe-884b-9f76806f6635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR52438',
 'listing': 'auction',
 'location': 'ES, Manresa',
 'make': 'BMW',
 'model': '3er',
 'odometer': 350994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_c38345661a6f41bf1de2ae4d9b18f551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_fe74daf445138e4f498f3f3915adf65a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_590ef8f80b7f9a47e73d24f92136faa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_92bd57358fcf0ffa839fdaca6509258c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_96c91f27907e3bef8e95edb967017382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d4e5bb-840e-5cfe-884b-9f76806f6635/a1d4e5bb-840e-5cfe-884b-9f76806f6635_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d4/7ad4e40995b1ecc529988eb7dc4055ed/pa/UR52438_71c1d5eea3cef37b4c55d4fd95f939c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR52438%27 HTTP/1.1" 200 None
2026-03-28 11:06:32 [auto1.es] INFO: Saving data for UR52438: {'created_time': 1774695992.518252, 'last_price_update_time': 1774695992.518262, 'auction_closing_time': 1774883576.0}
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR52438') HTTP/1.1" 204 0
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_a397dd4b133124fda84a05de97445aaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_199c24d44783a114245bc0a24b678b04.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82f4ad0>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_a397dd4b133124fda84a05de97445aaf.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_a397dd4b133124fda84a05de97445aaf.jpg saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8789ea8714d129e8f2d350125a5359f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6333f10>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F92%252F8092d3110a19e74bb6e147c5a2b0f4c1%252Fpa%252FYR47021_199c24d44783a114245bc0a24b678b04.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_199c24d44783a114245bc0a24b678b04.jpg saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9cb3c552-cad9-5af7-8006-6172f0435989
2026-03-28 11:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9cb3c552-cad9-5af7-8006-6172f0435989, skipping ID generation
2026-03-28 11:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cb3c552-cad9-5af7-8006-6172f0435989 with scrape type 1
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9cb3c552-cad9-5af7-8006-6172f0435989 sending to next pipeline
2026-03-28 11:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cb3c552-cad9-5af7-8006-6172f0435989, identifier: YR47021
2026-03-28 11:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cb3c552-cad9-5af7-8006-6172f0435989 with identifier: YR47021
2026-03-28 11:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cb3c552-cad9-5af7-8006-6172f0435989 with identifier: YR47021
2026-03-28 11:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cb3c552-cad9-5af7-8006-6172f0435989 with identifier: YR47021 to the API
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_199c24d44783a114245bc0a24b678b04.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:06:13Z',
 'fuel_type': 'petrol',
 'id': '9cb3c552-cad9-5af7-8006-6172f0435989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR47021',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 199748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_199c24d44783a114245bc0a24b678b04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_a397dd4b133124fda84a05de97445aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_d611ce82591943fb8f38af6654a93be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7939c319c369c22534701e3164c15dac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_bf1d82c806b3cb1531858563c0aacafa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7e576a18513e52974dba993d0a8339e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_db1811043582efb57a67bad0cf63bc0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_7a12ba082abbf2c49a0e8a42d613bab5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_59ccaae0e57155eda27bcd4d1ccb1988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cb3c552-cad9-5af7-8006-6172f0435989/9cb3c552-cad9-5af7-8006-6172f0435989_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/92/8092d3110a19e74bb6e147c5a2b0f4c1/pa/YR47021_fbdd830d398175fd6bd9a16b2e383358.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR47021%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [auto1.es] INFO: Saving data for YR47021: {'created_time': 1774695993.239848, 'last_price_update_time': 1774695993.239857, 'auction_closing_time': 1774883173.0}
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR47021') HTTP/1.1" 204 0
2026-03-28 11:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_62b9ffac0eef7cfef38bc227d1f66719.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82a9250>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ffb%252F8bfb5df28b3d7f7d819cdcac6e0a8b79%252Fpa%252FKU62533_8789ea8714d129e8f2d350125a5359f9.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8789ea8714d129e8f2d350125a5359f9.jpg saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa
2026-03-28 11:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa, skipping ID generation
2026-03-28 11:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa with scrape type 1
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa sending to next pipeline
2026-03-28 11:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa, identifier: KU62533
2026-03-28 11:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa with identifier: KU62533
2026-03-28 11:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa with identifier: KU62533
2026-03-28 11:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa with identifier: KU62533 to the API
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8789ea8714d129e8f2d350125a5359f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:35Z',
 'fuel_type': 'diesel',
 'id': 'b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU62533',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 265946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8789ea8714d129e8f2d350125a5359f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_3a95824cbb3b2b9e87f7a90dae844f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_f32013f031eb6be72627bec216f51404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_b232490bbd5515b783d0028ecc70b523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_ea65989534bf01b42249f5501b13c2d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_6a53be1cb724ad3e9cee16f13ca94401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_16e0021807b529acd2c66d9029154e86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_8e54536e98d91184f3b01641d90dfa29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_9a5b70ade79c34a28e25c31d12551667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa/b7735fe4-e242-5aaa-a1f8-6ae1f5b42daa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/fb/8bfb5df28b3d7f7d819cdcac6e0a8b79/pa/KU62533_646b072bb001578cc1a8c926d9fc1502.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2015}
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU62533%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [auto1.es] INFO: Saving data for KU62533: {'created_time': 1774695993.749918, 'last_price_update_time': 1774695993.749928, 'auction_closing_time': 1774884575.0}
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KU62533') HTTP/1.1" 204 0
2026-03-28 11:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_ae773fff75f452d73eb0a6db36246ec1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85eb390>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_62b9ffac0eef7cfef38bc227d1f66719.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_62b9ffac0eef7cfef38bc227d1f66719.jpg saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6453b10>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_ae773fff75f452d73eb0a6db36246ec1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_ae773fff75f452d73eb0a6db36246ec1.jpg saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_4a02b1dad1298a037dfbaf3aa4550a53.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e05640dc2787bedb1a71b3d4ff5c48f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630cfd0>
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_4a02b1dad1298a037dfbaf3aa4550a53.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_4a02b1dad1298a037dfbaf3aa4550a53.jpg saved to cache
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f651af10>
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_6e05640dc2787bedb1a71b3d4ff5c48f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e05640dc2787bedb1a71b3d4ff5c48f.jpg saved to cache
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_fa65dc20cb815a752f23d19576189706.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_554a8949e9804eace8f44712ba309dd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638f0d0>
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_fa65dc20cb815a752f23d19576189706.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_fa65dc20cb815a752f23d19576189706.jpg saved to cache
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f637c390>
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_554a8949e9804eace8f44712ba309dd5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_554a8949e9804eace8f44712ba309dd5.jpg saved to cache
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_589d4cef9bd898bf44ce25d616342463.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_6710c1a923ef70bcb0c214f25e8727f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645bd10>
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_589d4cef9bd898bf44ce25d616342463.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_589d4cef9bd898bf44ce25d616342463.jpg saved to cache
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6519c10>
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_6710c1a923ef70bcb0c214f25e8727f2.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_6710c1a923ef70bcb0c214f25e8727f2.jpg saved to cache
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8350a90>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F7e%252F297e66b7d4b44102f37bb597ab6bccd1%252Fpa%252FVG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg saved to cache
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda
2026-03-28 11:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e7037c6-ee18-5c99-a6fc-7bca839cacda, skipping ID generation
2026-03-28 11:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda with scrape type 1
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e7037c6-ee18-5c99-a6fc-7bca839cacda sending to next pipeline
2026-03-28 11:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e7037c6-ee18-5c99-a6fc-7bca839cacda, identifier: VG10975
2026-03-28 11:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e7037c6-ee18-5c99-a6fc-7bca839cacda with identifier: VG10975
2026-03-28 11:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e7037c6-ee18-5c99-a6fc-7bca839cacda with identifier: VG10975
2026-03-28 11:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e7037c6-ee18-5c99-a6fc-7bca839cacda with identifier: VG10975 to the API
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:25Z',
 'fuel_type': 'diesel',
 'id': '9e7037c6-ee18-5c99-a6fc-7bca839cacda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG10975',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 180429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_bfaa9da4a29103c15c029cf782f70abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_3e7d751ce5dd7bce244d6afec86f3732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_0905ca42591bd0b6a8e7ddf2fc458a50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_554a8949e9804eace8f44712ba309dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e05640dc2787bedb1a71b3d4ff5c48f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_acece4934df3a2b055d5b98aabf7a5fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_ae773fff75f452d73eb0a6db36246ec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_6e573d2c53dcdfb45d2854edc07b4135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_89db124af7a8627e9b8a57f54ffc487b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7037c6-ee18-5c99-a6fc-7bca839cacda/9e7037c6-ee18-5c99-a6fc-7bca839cacda_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/7e/297e66b7d4b44102f37bb597ab6bccd1/pa/VG10975_a3703d99def746bc11faa0d26d904c8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S80 2.4 D5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2006}
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG10975%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [auto1.es] INFO: Saving data for VG10975: {'created_time': 1774695995.519879, 'last_price_update_time': 1774695995.519889, 'auction_closing_time': 1774884265.0}
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG10975') HTTP/1.1" 204 0
2026-03-28 11:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_c8384c86c20d90e866b0f3223cff910d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP14618/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM94316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML70720/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_0313c060d156f4a39b1a8ffa645df608.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c3190>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_c8384c86c20d90e866b0f3223cff910d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_c8384c86c20d90e866b0f3223cff910d.jpg saved to cache
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59ae8d0>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6c%252F956cb69485d5700a174c38c206669a4a%252Fpa%252FHB49696_0313c060d156f4a39b1a8ffa645df608.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_0313c060d156f4a39b1a8ffa645df608.jpg saved to cache
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fb00534-c448-535c-9322-02c3699f4a5c
2026-03-28 11:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fb00534-c448-535c-9322-02c3699f4a5c, skipping ID generation
2026-03-28 11:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb00534-c448-535c-9322-02c3699f4a5c with scrape type 1
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fb00534-c448-535c-9322-02c3699f4a5c sending to next pipeline
2026-03-28 11:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fb00534-c448-535c-9322-02c3699f4a5c, identifier: HB49696
2026-03-28 11:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fb00534-c448-535c-9322-02c3699f4a5c with identifier: HB49696
2026-03-28 11:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fb00534-c448-535c-9322-02c3699f4a5c with identifier: HB49696
2026-03-28 11:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fb00534-c448-535c-9322-02c3699f4a5c with identifier: HB49696 to the API
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_0313c060d156f4a39b1a8ffa645df608.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:37:53Z',
 'fuel_type': 'diesel',
 'id': '0fb00534-c448-535c-9322-02c3699f4a5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB49696',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 110772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_0313c060d156f4a39b1a8ffa645df608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_c8384c86c20d90e866b0f3223cff910d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_6710c1a923ef70bcb0c214f25e8727f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_589d4cef9bd898bf44ce25d616342463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_fa65dc20cb815a752f23d19576189706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_7157561f91874ff649fe30aad028a0a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_4a02b1dad1298a037dfbaf3aa4550a53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_62b9ffac0eef7cfef38bc227d1f66719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_ea7640b51b06d51d08015209a0cfb98f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb00534-c448-535c-9322-02c3699f4a5c/0fb00534-c448-535c-9322-02c3699f4a5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6c/956cb69485d5700a174c38c206669a4a/pa/HB49696_658fb6fc81364317c804dc7b4e5ac4c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2012}
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB49696%27 HTTP/1.1" 200 None
2026-03-28 11:06:36 [auto1.es] INFO: Saving data for HB49696: {'created_time': 1774695996.847714, 'last_price_update_time': 1774695996.847725, 'auction_closing_time': 1774885073.0}
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB49696') HTTP/1.1" 204 0
2026-03-28 11:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_bed62fbe5d5dcbf6a73bf2b6514cced1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM88527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59aff50>
2026-03-28 11:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_bed62fbe5d5dcbf6a73bf2b6514cced1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_bed62fbe5d5dcbf6a73bf2b6514cced1.jpg saved to cache
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:37 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2559 | hits on page: 40
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: JZ72773
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX89883%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for SX89883: 0
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: KP23641
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP23641%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for KP23641: 1
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: ZT45272
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT45272%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for ZT45272: 1
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: EW17140
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: GP84876
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP84876%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for GP84876: 1
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: FF19626
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: GG14536
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14536%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for GG14536: 1
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: XF41535
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: KK57262
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: PL51206
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL51206%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for PL51206: 1
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_81eb96c58bb8ab1c7ff93f043ed22af6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: GZ44796
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ44796%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for GZ44796: 1
2026-03-28 11:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: EU70316
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: PN86377
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN86377%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for PN86377: 1
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: MF61460
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: JS10706
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE73826%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for CE73826: 1
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB82673%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for XB82673: 2
2026-03-28 11:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673
2026-03-28 11:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with scrape type 2
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with scrape type 2
2026-03-28 11:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de6db737-e8b2-5b8b-9d04-6f97bc5b0715, identifier: XB82673
2026-03-28 11:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673
2026-03-28 11:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673
2026-03-28 11:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673 to the API
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:40:18Z',
 'fuel_type': 'petrol',
 'id': 'de6db737-e8b2-5b8b-9d04-6f97bc5b0715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB82673',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 101049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-07',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB82673%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Saving data for XB82673: {'auction_closing_time': 1774885218.0, 'created_time': 1774037319.68861, 'last_price_update_time': 1774695997.655382}
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB82673') HTTP/1.1" 204 0
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: NM22189
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM22189%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for NM22189: 1
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e9682b6fd79f562060d5b2236c7664ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630ced0>
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_81eb96c58bb8ab1c7ff93f043ed22af6.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_81eb96c58bb8ab1c7ff93f043ed22af6.jpg saved to cache
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: BA61536
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: UP09375
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: GE22021
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: FA09072
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: ZH42049
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: LB38939
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: US62634
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: YH49695
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH49695%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for YH49695: 0
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW91373%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for RW91373: 0
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG74328%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for LG74328: 0
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG63896%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for ZG63896: 0
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-28 11:06:37 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU26922%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [auto1.es] INFO: Scrape type for VU26922: 0
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM94316> (referer: https://www.auto1.com/v1/car-details-view/BM94316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR07700> (referer: https://www.auto1.com/v1/car-details-view/RR07700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8313190>
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_e9682b6fd79f562060d5b2236c7664ef.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e9682b6fd79f562060d5b2236c7664ef.jpg saved to cache
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML70720> (referer: https://www.auto1.com/v1/car-details-view/ML70720/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e390e94ddd7e4a2ff44f711a70848877.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP14618> (referer: https://www.auto1.com/v1/car-details-view/NP14618/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73fb821f-6c19-5407-b8eb-25468f06eaad with identifier: BM94316
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73fb821f-6c19-5407-b8eb-25468f06eaad with scrape type 1
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg not downloaded yet
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1933d201-586e-5488-9e85-4a087cfd7e25 with identifier: RR07700
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1933d201-586e-5488-9e85-4a087cfd7e25 with scrape type 1
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_f68db7a64be686f4b41ff63441c485bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_f68db7a64be686f4b41ff63441c485bc.jpg not downloaded yet
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_89848a4bacbafb325a36ee36b095b994.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_89848a4bacbafb325a36ee36b095b994.jpg not downloaded yet
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_172ff6f9e986f843be6ad63f4782fc28.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_172ff6f9e986f843be6ad63f4782fc28.jpg not downloaded yet
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_491ab547d65e5b688acc27da8cc12c99.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_1368c7fc42ce9bbd3481951765991ef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_1368c7fc42ce9bbd3481951765991ef5.jpg not downloaded yet
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_08b01c7a3b86496e62f386a2c291447b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_08b01c7a3b86496e62f386a2c291447b.jpg not downloaded yet
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79efab29-f494-52a6-8bfe-15ba7bead4b9 with scrape type 1
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79efab29-f494-52a6-8bfe-15ba7bead4b9
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_0f7fd35bb3b479cb5f42a388027cca4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_0f7fd35bb3b479cb5f42a388027cca4e.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_ec43d2599de3b14ff07b0c2fec63d5d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_ec43d2599de3b14ff07b0c2fec63d5d7.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_0301e8196320702f460e00acbd01aeed.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_0301e8196320702f460e00acbd01aeed.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_5330d91c0b29bf93e12cf4cc11cf0bfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_5330d91c0b29bf93e12cf4cc11cf0bfd.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_4ad7c2277cb3c2bead68d7ab1ec099a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_4ad7c2277cb3c2bead68d7ab1ec099a7.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_997affd5fdd40e071b1be1c7b0019d9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_997affd5fdd40e071b1be1c7b0019d9f.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_e6b7259a63f4d6a984ae4390cce2639b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_e6b7259a63f4d6a984ae4390cce2639b.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_7ef2b8014c384a35148f1cb6d54424c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_7ef2b8014c384a35148f1cb6d54424c9.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_ea1c7d8d36357268b88a8fdc95631bba.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_ea1c7d8d36357268b88a8fdc95631bba.jpg already downloaded
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fe4%252F1ce4b8901acff2cb903aa6bcae78e72a%252Fpa%252FML70720_87aa6edc3bb2cac3dc8c39cbe1d2cb7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_87aa6edc3bb2cac3dc8c39cbe1d2cb7e.jpg already downloaded
2026-03-28 11:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 79efab29-f494-52a6-8bfe-15ba7bead4b9, identifier: ML70720
2026-03-28 11:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720
2026-03-28 11:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720
2026-03-28 11:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720 to the API
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML70720>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:11:40Z',
 'fuel_type': 'diesel',
 'id': '79efab29-f494-52a6-8bfe-15ba7bead4b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML70720',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 123222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_0f7fd35bb3b479cb5f42a388027cca4e.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_ec43d2599de3b14ff07b0c2fec63d5d7.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_0301e8196320702f460e00acbd01aeed.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_5330d91c0b29bf93e12cf4cc11cf0bfd.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_4ad7c2277cb3c2bead68d7ab1ec099a7.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_997affd5fdd40e071b1be1c7b0019d9f.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_e6b7259a63f4d6a984ae4390cce2639b.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_7ef2b8014c384a35148f1cb6d54424c9.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_ea1c7d8d36357268b88a8fdc95631bba.jpg',
                'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_87aa6edc3bb2cac3dc8c39cbe1d2cb7e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_0f7fd35bb3b479cb5f42a388027cca4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_ec43d2599de3b14ff07b0c2fec63d5d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_0301e8196320702f460e00acbd01aeed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_5330d91c0b29bf93e12cf4cc11cf0bfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_4ad7c2277cb3c2bead68d7ab1ec099a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_997affd5fdd40e071b1be1c7b0019d9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_e6b7259a63f4d6a984ae4390cce2639b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_7ef2b8014c384a35148f1cb6d54424c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_ea1c7d8d36357268b88a8fdc95631bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79efab29-f494-52a6-8bfe-15ba7bead4b9/79efab29-f494-52a6-8bfe-15ba7bead4b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/e4/1ce4b8901acff2cb903aa6bcae78e72a/pa/ML70720_87aa6edc3bb2cac3dc8c39cbe1d2cb7e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML70720%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.es] INFO: Saving data for ML70720: {'created_time': 1774695998.812135, 'last_price_update_time': 1774695998.812148, 'auction_closing_time': 1774883500.0}
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ML70720') HTTP/1.1" 204 0
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_8cc247c790615c1b94d5f8f9349bbb0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_8cc247c790615c1b94d5f8f9349bbb0b.jpg not downloaded yet
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_ddf60ab446bab9709beb1cde7ed26d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_ddf60ab446bab9709beb1cde7ed26d1d.jpg not downloaded yet
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_7678dafb0fee89c6ee4d16581f27ba93.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_7678dafb0fee89c6ee4d16581f27ba93.jpg not downloaded yet
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_51fc20b10f71c26b50690fcdfe4457f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_51fc20b10f71c26b50690fcdfe4457f0.jpg not downloaded yet
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL51206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f650aad0>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_e390e94ddd7e4a2ff44f711a70848877.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e390e94ddd7e4a2ff44f711a70848877.jpg saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311584f6-cd0d-5c82-bcd4-4eff57d54f30 with identifier: NP14618
2026-03-28 11:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30 with scrape type 1
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_5ff740405aa3446f55a75bb9fc723032.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_5ff740405aa3446f55a75bb9fc723032.jpg not downloaded yet
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630cad0>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc5%252F29c5868b5b56f6646c7673d9319d50f8%252Fpa%252FXF82752_491ab547d65e5b688acc27da8cc12c99.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_491ab547d65e5b688acc27da8cc12c99.jpg saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd177684-81d5-56c5-bb9d-436c56f3b3f1
2026-03-28 11:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd177684-81d5-56c5-bb9d-436c56f3b3f1, skipping ID generation
2026-03-28 11:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd177684-81d5-56c5-bb9d-436c56f3b3f1 with scrape type 1
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd177684-81d5-56c5-bb9d-436c56f3b3f1 sending to next pipeline
2026-03-28 11:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd177684-81d5-56c5-bb9d-436c56f3b3f1, identifier: XF82752
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_6da1346bd0ddee10527c302e644cb5f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_6da1346bd0ddee10527c302e644cb5f4.jpg not downloaded yet
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_6bed4e0a67b7aafa76c88a4bb631536b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_6bed4e0a67b7aafa76c88a4bb631536b.jpg not downloaded yet
2026-03-28 11:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd177684-81d5-56c5-bb9d-436c56f3b3f1 with identifier: XF82752
2026-03-28 11:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd177684-81d5-56c5-bb9d-436c56f3b3f1 with identifier: XF82752
2026-03-28 11:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd177684-81d5-56c5-bb9d-436c56f3b3f1 with identifier: XF82752 to the API
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_491ab547d65e5b688acc27da8cc12c99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': 'Rental',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:19Z',
 'fuel_type': 'diesel',
 'id': 'dd177684-81d5-56c5-bb9d-436c56f3b3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF82752',
 'listing': 'auction',
 'location': 'ES, San Juan de Aznalfarache, Sevilla',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 94603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_491ab547d65e5b688acc27da8cc12c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e390e94ddd7e4a2ff44f711a70848877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e9682b6fd79f562060d5b2236c7664ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_81eb96c58bb8ab1c7ff93f043ed22af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_fa69e4d086027434e2c75a83b5dfeac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_bed62fbe5d5dcbf6a73bf2b6514cced1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_df3b945c134a8aad71ca02c78c10dd96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_b354932b0bb3bf24c4e2258ba0df92de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_e205e970464c50515d861f00fa11bc76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd177684-81d5-56c5-bb9d-436c56f3b3f1/dd177684-81d5-56c5-bb9d-436c56f3b3f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c5/29c5868b5b56f6646c7673d9319d50f8/pa/XF82752_2cebf94b4bb3d8d6afc00caa30bcf99f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.3 M-Jet Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF82752%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [auto1.es] INFO: Saving data for XF82752: {'created_time': 1774695999.623815, 'last_price_update_time': 1774695999.623824, 'auction_closing_time': 1774884619.0}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XF82752') HTTP/1.1" 204 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_db5d57309ccdd3051fbc1c6fb247c3e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_db5d57309ccdd3051fbc1c6fb247c3e1.jpg not downloaded yet
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ44796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f58a2b50>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26591f7a-c0d4-563a-8053-ea96c484618f
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_172ff6f9e986f843be6ad63f4782fc28.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_674273420b968224d3f2bc1d4b556c21.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_674273420b968224d3f2bc1d4b556c21.jpg not downloaded yet
2026-03-28 11:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_52a8f38e1a313794ec97170489c603f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_52a8f38e1a313794ec97170489c603f1.jpg not downloaded yet
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_7d8d0f27f1b725da9dab4a08e69e52eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_7d8d0f27f1b725da9dab4a08e69e52eb.jpg not downloaded yet
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_43c7b4894113faed6ee6edaff0311052.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_43c7b4894113faed6ee6edaff0311052.jpg not downloaded yet
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM22189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_3602b23df2c6e788bf50aeb5eacc9ce5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_3602b23df2c6e788bf50aeb5eacc9ce5.jpg not downloaded yet
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_ddf60ab446bab9709beb1cde7ed26d1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_e34e72d7babe6324d83eed88a89344b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_e34e72d7babe6324d83eed88a89344b0.jpg not downloaded yet
2026-03-28 11:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638b190>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_172ff6f9e986f843be6ad63f4782fc28.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_172ff6f9e986f843be6ad63f4782fc28.jpg saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_cf807ebd7d8025dc5bcfc012f6c273ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_cf807ebd7d8025dc5bcfc012f6c273ac.jpg not downloaded yet
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_8963baad21abe481c51887048d759b5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_8963baad21abe481c51887048d759b5b.jpg not downloaded yet
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN86377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59ea7d0>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_ddf60ab446bab9709beb1cde7ed26d1d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_ddf60ab446bab9709beb1cde7ed26d1d.jpg saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_8cc247c790615c1b94d5f8f9349bbb0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_db5d57309ccdd3051fbc1c6fb247c3e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82aaf50>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_8cc247c790615c1b94d5f8f9349bbb0b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_8cc247c790615c1b94d5f8f9349bbb0b.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_43c7b4894113faed6ee6edaff0311052.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f637d690>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_db5d57309ccdd3051fbc1c6fb247c3e1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_db5d57309ccdd3051fbc1c6fb247c3e1.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_8963baad21abe481c51887048d759b5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a5890>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_43c7b4894113faed6ee6edaff0311052.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_43c7b4894113faed6ee6edaff0311052.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG14536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_cf807ebd7d8025dc5bcfc012f6c273ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP84876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e9290>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_8963baad21abe481c51887048d759b5b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_8963baad21abe481c51887048d759b5b.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_e34e72d7babe6324d83eed88a89344b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f629ff10>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_cf807ebd7d8025dc5bcfc012f6c273ac.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_cf807ebd7d8025dc5bcfc012f6c273ac.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_3602b23df2c6e788bf50aeb5eacc9ce5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ffd10>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_e34e72d7babe6324d83eed88a89344b0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_e34e72d7babe6324d83eed88a89344b0.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_7d8d0f27f1b725da9dab4a08e69e52eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f591dc90>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_3602b23df2c6e788bf50aeb5eacc9ce5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_3602b23df2c6e788bf50aeb5eacc9ce5.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_52a8f38e1a313794ec97170489c603f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85f6110>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_7d8d0f27f1b725da9dab4a08e69e52eb.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_7d8d0f27f1b725da9dab4a08e69e52eb.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_674273420b968224d3f2bc1d4b556c21.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ44796> (referer: https://www.auto1.com/v1/car-details-view/GZ44796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL51206> (referer: https://www.auto1.com/v1/car-details-view/PL51206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6433390>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_52a8f38e1a313794ec97170489c603f1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_52a8f38e1a313794ec97170489c603f1.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_6bed4e0a67b7aafa76c88a4bb631536b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6461250>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_674273420b968224d3f2bc1d4b556c21.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_674273420b968224d3f2bc1d4b556c21.jpg saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4403fc59-59a8-56aa-8a58-fd078cbc3802 with identifier: GZ44796
2026-03-28 11:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4403fc59-59a8-56aa-8a58-fd078cbc3802 with scrape type 1
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg not downloaded yet
2026-03-28 11:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04748421-d697-5e08-a5ce-d98486e83e22 with identifier: PL51206
2026-03-28 11:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04748421-d697-5e08-a5ce-d98486e83e22 with scrape type 1
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg not downloaded yet
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_046549d6b61b49a1d4d82cb35c0d8f37.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_046549d6b61b49a1d4d82cb35c0d8f37.jpg not downloaded yet
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_c8449aa085341b51001877b06484e18c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_c8449aa085341b51001877b06484e18c.jpg not downloaded yet
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_45ff52b9d4f144e661d77256f456edaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_45ff52b9d4f144e661d77256f456edaa.jpg not downloaded yet
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_ca8217cf5d5c01fbcae1efa9e4d78b28.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ca8217cf5d5c01fbcae1efa9e4d78b28.jpg not downloaded yet
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82ab6d0>
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_6bed4e0a67b7aafa76c88a4bb631536b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_6bed4e0a67b7aafa76c88a4bb631536b.jpg saved to cache
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_aee525052dfb946011dc374425ba5167.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_aee525052dfb946011dc374425ba5167.jpg not downloaded yet
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_189f6ad9beaf03b0af40a3875ca766be.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_189f6ad9beaf03b0af40a3875ca766be.jpg not downloaded yet
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_6da1346bd0ddee10527c302e644cb5f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_5283827732a794e4083fc2ddf4e7eabe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_5283827732a794e4083fc2ddf4e7eabe.jpg not downloaded yet
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_35a28321063c426acbe9489c9b824812.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_35a28321063c426acbe9489c9b824812.jpg not downloaded yet
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_edea96a2552fe94a55a744b7068e5368.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_edea96a2552fe94a55a744b7068e5368.jpg not downloaded yet
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_1ac0f569a5c81f52fd27831045ac8238.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_1ac0f569a5c81f52fd27831045ac8238.jpg not downloaded yet
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_5ff740405aa3446f55a75bb9fc723032.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63af990>
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_6da1346bd0ddee10527c302e644cb5f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_6da1346bd0ddee10527c302e644cb5f4.jpg saved to cache
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_51fc20b10f71c26b50690fcdfe4457f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN86377> (referer: https://www.auto1.com/v1/car-details-view/PN86377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645b850>
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F7d%252Fbc7d9c34b1db8dbe3e7b17819edc920b%252Fpa%252FNP14618_5ff740405aa3446f55a75bb9fc723032.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_5ff740405aa3446f55a75bb9fc723032.jpg saved to cache
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30
2026-03-28 11:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 311584f6-cd0d-5c82-bcd4-4eff57d54f30, skipping ID generation
2026-03-28 11:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30 with scrape type 1
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 311584f6-cd0d-5c82-bcd4-4eff57d54f30 sending to next pipeline
2026-03-28 11:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 311584f6-cd0d-5c82-bcd4-4eff57d54f30, identifier: NP14618
2026-03-28 11:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 311584f6-cd0d-5c82-bcd4-4eff57d54f30 with identifier: NP14618
2026-03-28 11:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 311584f6-cd0d-5c82-bcd4-4eff57d54f30 with identifier: NP14618
2026-03-28 11:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 311584f6-cd0d-5c82-bcd4-4eff57d54f30 with identifier: NP14618 to the API
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_5ff740405aa3446f55a75bb9fc723032.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:06:14Z',
 'fuel_type': 'petrol',
 'id': '311584f6-cd0d-5c82-bcd4-4eff57d54f30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP14618',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 33867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_5ff740405aa3446f55a75bb9fc723032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_db5d57309ccdd3051fbc1c6fb247c3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_674273420b968224d3f2bc1d4b556c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_52a8f38e1a313794ec97170489c603f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_7d8d0f27f1b725da9dab4a08e69e52eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_43c7b4894113faed6ee6edaff0311052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_3602b23df2c6e788bf50aeb5eacc9ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_e34e72d7babe6324d83eed88a89344b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_cf807ebd7d8025dc5bcfc012f6c273ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311584f6-cd0d-5c82-bcd4-4eff57d54f30/311584f6-cd0d-5c82-bcd4-4eff57d54f30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/7d/bc7d9c34b1db8dbe3e7b17819edc920b/pa/NP14618_8963baad21abe481c51887048d759b5b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP14618%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [auto1.es] INFO: Saving data for NP14618: {'created_time': 1774696001.951208, 'last_price_update_time': 1774696001.951218, 'auction_closing_time': 1774883174.0}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NP14618') HTTP/1.1" 204 0
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_7678dafb0fee89c6ee4d16581f27ba93.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM22189> (referer: https://www.auto1.com/v1/car-details-view/NM22189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG14536> (referer: https://www.auto1.com/v1/car-details-view/GG14536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP84876> (referer: https://www.auto1.com/v1/car-details-view/GP84876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6453390>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_51fc20b10f71c26b50690fcdfe4457f0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_51fc20b10f71c26b50690fcdfe4457f0.jpg saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a58b22c-0b7e-53a0-8697-4dac9320e98c with identifier: PN86377
2026-03-28 11:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c with scrape type 1
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_6485dcc6c648b23076e01de8eac98a4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_6485dcc6c648b23076e01de8eac98a4e.jpg not downloaded yet
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9805f90490>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_7678dafb0fee89c6ee4d16581f27ba93.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_7678dafb0fee89c6ee4d16581f27ba93.jpg saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce88e9d8-6838-51f7-b591-2d6570fb85d1 with identifier: NM22189
2026-03-28 11:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce88e9d8-6838-51f7-b591-2d6570fb85d1 with scrape type 1
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_201aa516b928520f6db75b979317874a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_201aa516b928520f6db75b979317874a.jpg not downloaded yet
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54b9ce48-9f93-5779-9ced-aec521f516fb with identifier: GG14536
2026-03-28 11:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54b9ce48-9f93-5779-9ced-aec521f516fb with scrape type 1
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_595d3509b496c1bbdf5a1888ceeccb87.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_595d3509b496c1bbdf5a1888ceeccb87.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_f70322bd7b35cbb7f88f888a824f4c5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f70322bd7b35cbb7f88f888a824f4c5a.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_dd2bd7aad675e5fde6e4e9663d6a2107.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_dd2bd7aad675e5fde6e4e9663d6a2107.jpg not downloaded yet
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ca8217cf5d5c01fbcae1efa9e4d78b28.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_2c4032cdf1f7d47aedab9e9e3c4e8e89.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_2c4032cdf1f7d47aedab9e9e3c4e8e89.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_7bd9dc6b67542114eea2e81f0f30d5f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_7bd9dc6b67542114eea2e81f0f30d5f6.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_0e22056f6ab68f6a07b841e2804fd90d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_0e22056f6ab68f6a07b841e2804fd90d.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_d38f964560b3f1eba7851745b7926a1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_d38f964560b3f1eba7851745b7926a1f.jpg not downloaded yet
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efa0eae-a575-5161-a57d-7f17e0259748 with identifier: GP84876
2026-03-28 11:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efa0eae-a575-5161-a57d-7f17e0259748 with scrape type 1
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_c17eee6998b119598be619b26dcd24a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_c17eee6998b119598be619b26dcd24a7.jpg not downloaded yet
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_35a28321063c426acbe9489c9b824812.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_78941bf1adb45f4bdd99d90da85b6b1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_78941bf1adb45f4bdd99d90da85b6b1e.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_c2d45c78e4d276b13454333da3d4f42e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_c2d45c78e4d276b13454333da3d4f42e.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_1244abfa7fabc7cbae4b58480fcbefe9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_1244abfa7fabc7cbae4b58480fcbefe9.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_139d700793977138b4208ca9c6bda462.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_139d700793977138b4208ca9c6bda462.jpg not downloaded yet
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE73826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62cf810>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_ca8217cf5d5c01fbcae1efa9e4d78b28.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ca8217cf5d5c01fbcae1efa9e4d78b28.jpg saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_f18b06504c04c1e62d2f364b14556bb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f18b06504c04c1e62d2f364b14556bb1.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_b4ddecc6cb08003e2d90e53a00ef9a31.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b4ddecc6cb08003e2d90e53a00ef9a31.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_c3b9648c1ee05bacf9e612231ea50290.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_c3b9648c1ee05bacf9e612231ea50290.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_b515921840725fbc8d2f0f06a0e8c64f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b515921840725fbc8d2f0f06a0e8c64f.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_d1d0734d7835eb445753723931ee3930.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_d1d0734d7835eb445753723931ee3930.jpg not downloaded yet
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_1ac0f569a5c81f52fd27831045ac8238.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_f3648f46e9e278b09be9427307d8b96a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f3648f46e9e278b09be9427307d8b96a.jpg not downloaded yet
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645ff10>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_35a28321063c426acbe9489c9b824812.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_35a28321063c426acbe9489c9b824812.jpg saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_6b3d8f76e4ac3e9134866ed1821aed72.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_6b3d8f76e4ac3e9134866ed1821aed72.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_05bbbe79984d199146a7d3c8fb5395e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_05bbbe79984d199146a7d3c8fb5395e5.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_7a5e3e52f92e919851183a6ef4c70a14.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_7a5e3e52f92e919851183a6ef4c70a14.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_b2b6b413135e37f6b908782e978d1298.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_b2b6b413135e37f6b908782e978d1298.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_865037eec04d1e9da97eb646250be511.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_865037eec04d1e9da97eb646250be511.jpg not downloaded yet
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_edea96a2552fe94a55a744b7068e5368.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_d21010d3464672b7fddc2850edb9da75.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_d21010d3464672b7fddc2850edb9da75.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_8e3037898f1c8c8af5f97d8212d989bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_8e3037898f1c8c8af5f97d8212d989bb.jpg not downloaded yet
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f0a90>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_1ac0f569a5c81f52fd27831045ac8238.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_1ac0f569a5c81f52fd27831045ac8238.jpg saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_fbd3c7d41a4bd36a7ba26c8ab5ffb0f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_fbd3c7d41a4bd36a7ba26c8ab5ffb0f3.jpg not downloaded yet
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_5809695d2ce153d8a084db928c25b865.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_5809695d2ce153d8a084db928c25b865.jpg not downloaded yet
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f2c50>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_edea96a2552fe94a55a744b7068e5368.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_edea96a2552fe94a55a744b7068e5368.jpg saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_5283827732a794e4083fc2ddf4e7eabe.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_189f6ad9beaf03b0af40a3875ca766be.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6388f50>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_5283827732a794e4083fc2ddf4e7eabe.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_5283827732a794e4083fc2ddf4e7eabe.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_aee525052dfb946011dc374425ba5167.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59a2e90>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_189f6ad9beaf03b0af40a3875ca766be.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_189f6ad9beaf03b0af40a3875ca766be.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_45ff52b9d4f144e661d77256f456edaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a1ccd0>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_aee525052dfb946011dc374425ba5167.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_aee525052dfb946011dc374425ba5167.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_595d3509b496c1bbdf5a1888ceeccb87.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59a0550>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_45ff52b9d4f144e661d77256f456edaa.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_45ff52b9d4f144e661d77256f456edaa.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_c17eee6998b119598be619b26dcd24a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62c4e10>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_595d3509b496c1bbdf5a1888ceeccb87.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_595d3509b496c1bbdf5a1888ceeccb87.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e56d0>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_c17eee6998b119598be619b26dcd24a7.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_c17eee6998b119598be619b26dcd24a7.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_139d700793977138b4208ca9c6bda462.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b515921840725fbc8d2f0f06a0e8c64f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f3590>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_139d700793977138b4208ca9c6bda462.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_139d700793977138b4208ca9c6bda462.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ae5d0>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_b515921840725fbc8d2f0f06a0e8c64f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b515921840725fbc8d2f0f06a0e8c64f.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_865037eec04d1e9da97eb646250be511.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6432f90>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_865037eec04d1e9da97eb646250be511.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_865037eec04d1e9da97eb646250be511.jpg saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_5809695d2ce153d8a084db928c25b865.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82ab510>
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_5809695d2ce153d8a084db928c25b865.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_5809695d2ce153d8a084db928c25b865.jpg saved to cache
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_fbd3c7d41a4bd36a7ba26c8ab5ffb0f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f641b710>
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_fbd3c7d41a4bd36a7ba26c8ab5ffb0f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_fbd3c7d41a4bd36a7ba26c8ab5ffb0f3.jpg saved to cache
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_8e3037898f1c8c8af5f97d8212d989bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE73826> (referer: https://www.auto1.com/v1/car-details-view/CE73826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a1f390>
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_8e3037898f1c8c8af5f97d8212d989bb.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_8e3037898f1c8c8af5f97d8212d989bb.jpg saved to cache
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826
2026-03-28 11:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27994e4-df0b-53e0-a600-74328038f075 with scrape type 1
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c27994e4-df0b-53e0-a600-74328038f075
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_832f0405bcc7f0b4982d37b1c522a70a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_832f0405bcc7f0b4982d37b1c522a70a.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_5add626cb8986a8dac712203eb8dceae.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_5add626cb8986a8dac712203eb8dceae.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_080dc795c94ae5d82e34a1cc2269729f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_080dc795c94ae5d82e34a1cc2269729f.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_4459e0745699d0aeee01985a68652a3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_4459e0745699d0aeee01985a68652a3d.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_3f9435070b58ed8f836795fd0f87acab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_3f9435070b58ed8f836795fd0f87acab.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_363c2e174bdebfaf5d22ae809b081ce6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_363c2e174bdebfaf5d22ae809b081ce6.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_3e23ae7a71cb1ef988cbd871163a99f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_3e23ae7a71cb1ef988cbd871163a99f3.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_5ace26530f3703d0cb6073f0a62dc53b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_5ace26530f3703d0cb6073f0a62dc53b.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_499887244046b83d60cebf48cad26b73.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_499887244046b83d60cebf48cad26b73.jpg already downloaded
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff021280110ee2f8f72b0abe919e277c1%252Fpa%252FCE73826_2f3260f2eb9ce0b39d1e0cd351bc9a0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_2f3260f2eb9ce0b39d1e0cd351bc9a0e.jpg already downloaded
2026-03-28 11:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c27994e4-df0b-53e0-a600-74328038f075, identifier: CE73826
2026-03-28 11:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826
2026-03-28 11:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826
2026-03-28 11:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826 to the API
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE73826>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:07:23Z',
 'fuel_type': 'diesel',
 'id': 'c27994e4-df0b-53e0-a600-74328038f075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE73826',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 89411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_832f0405bcc7f0b4982d37b1c522a70a.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_5add626cb8986a8dac712203eb8dceae.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_080dc795c94ae5d82e34a1cc2269729f.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_4459e0745699d0aeee01985a68652a3d.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_3f9435070b58ed8f836795fd0f87acab.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_363c2e174bdebfaf5d22ae809b081ce6.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_3e23ae7a71cb1ef988cbd871163a99f3.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_5ace26530f3703d0cb6073f0a62dc53b.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_499887244046b83d60cebf48cad26b73.jpg',
                'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_2f3260f2eb9ce0b39d1e0cd351bc9a0e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_832f0405bcc7f0b4982d37b1c522a70a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_5add626cb8986a8dac712203eb8dceae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_080dc795c94ae5d82e34a1cc2269729f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_4459e0745699d0aeee01985a68652a3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_3f9435070b58ed8f836795fd0f87acab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_363c2e174bdebfaf5d22ae809b081ce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_3e23ae7a71cb1ef988cbd871163a99f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_5ace26530f3703d0cb6073f0a62dc53b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_499887244046b83d60cebf48cad26b73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27994e4-df0b-53e0-a600-74328038f075/c27994e4-df0b-53e0-a600-74328038f075_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f021280110ee2f8f72b0abe919e277c1/pa/CE73826_2f3260f2eb9ce0b39d1e0cd351bc9a0e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2021}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE73826%27 HTTP/1.1" 200 None
2026-03-28 11:06:45 [auto1.es] INFO: Saving data for CE73826: {'created_time': 1774696005.363277, 'last_price_update_time': 1774696005.363288, 'auction_closing_time': 1774883243.0}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE73826') HTTP/1.1" 204 0
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_d21010d3464672b7fddc2850edb9da75.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6301510>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_d21010d3464672b7fddc2850edb9da75.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_d21010d3464672b7fddc2850edb9da75.jpg saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_b2b6b413135e37f6b908782e978d1298.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e4ad0>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_b2b6b413135e37f6b908782e978d1298.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_b2b6b413135e37f6b908782e978d1298.jpg saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_7a5e3e52f92e919851183a6ef4c70a14.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f71e5310>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_7a5e3e52f92e919851183a6ef4c70a14.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_7a5e3e52f92e919851183a6ef4c70a14.jpg saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_05bbbe79984d199146a7d3c8fb5395e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64587d0>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_05bbbe79984d199146a7d3c8fb5395e5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_05bbbe79984d199146a7d3c8fb5395e5.jpg saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_6b3d8f76e4ac3e9134866ed1821aed72.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8359250>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_6b3d8f76e4ac3e9134866ed1821aed72.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_6b3d8f76e4ac3e9134866ed1821aed72.jpg saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f3648f46e9e278b09be9427307d8b96a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6459e50>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_f3648f46e9e278b09be9427307d8b96a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f3648f46e9e278b09be9427307d8b96a.jpg saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_d1d0734d7835eb445753723931ee3930.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e4d10>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_d1d0734d7835eb445753723931ee3930.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_d1d0734d7835eb445753723931ee3930.jpg saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_c3b9648c1ee05bacf9e612231ea50290.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6301b50>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_c3b9648c1ee05bacf9e612231ea50290.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_c3b9648c1ee05bacf9e612231ea50290.jpg saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b4ddecc6cb08003e2d90e53a00ef9a31.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63fddd0>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F9b%252Fc49b0e31f083094677c6fcb4234ce1e6%252Fpa%252FGP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3efa0eae-a575-5161-a57d-7f17e0259748
2026-03-28 11:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3efa0eae-a575-5161-a57d-7f17e0259748, skipping ID generation
2026-03-28 11:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efa0eae-a575-5161-a57d-7f17e0259748 with scrape type 1
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3efa0eae-a575-5161-a57d-7f17e0259748 sending to next pipeline
2026-03-28 11:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3efa0eae-a575-5161-a57d-7f17e0259748, identifier: GP84876
2026-03-28 11:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3efa0eae-a575-5161-a57d-7f17e0259748 with identifier: GP84876
2026-03-28 11:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3efa0eae-a575-5161-a57d-7f17e0259748 with identifier: GP84876
2026-03-28 11:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3efa0eae-a575-5161-a57d-7f17e0259748 with identifier: GP84876 to the API
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:08:07Z',
 'fuel_type': 'diesel',
 'id': '3efa0eae-a575-5161-a57d-7f17e0259748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP84876',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 132038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_c17eee6998b119598be619b26dcd24a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_139d700793977138b4208ca9c6bda462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_1b53c55bfec4525ee248f7b129de1bcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_d1d0734d7835eb445753723931ee3930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_6b3d8f76e4ac3e9134866ed1821aed72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_7a5e3e52f92e919851183a6ef4c70a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_865037eec04d1e9da97eb646250be511.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_8e3037898f1c8c8af5f97d8212d989bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_fbd3c7d41a4bd36a7ba26c8ab5ffb0f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efa0eae-a575-5161-a57d-7f17e0259748/3efa0eae-a575-5161-a57d-7f17e0259748_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/9b/c49b0e31f083094677c6fcb4234ce1e6/pa/GP84876_5809695d2ce153d8a084db928c25b865.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP84876%27 HTTP/1.1" 200 None
2026-03-28 11:06:47 [auto1.es] INFO: Saving data for GP84876: {'created_time': 1774696007.459662, 'last_price_update_time': 1774696007.459674, 'auction_closing_time': 1774883287.0}
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GP84876') HTTP/1.1" 204 0
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f18b06504c04c1e62d2f364b14556bb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f643f610>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_b4ddecc6cb08003e2d90e53a00ef9a31.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b4ddecc6cb08003e2d90e53a00ef9a31.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_1244abfa7fabc7cbae4b58480fcbefe9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e7990>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_f18b06504c04c1e62d2f364b14556bb1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f18b06504c04c1e62d2f364b14556bb1.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_c2d45c78e4d276b13454333da3d4f42e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638aa50>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_1244abfa7fabc7cbae4b58480fcbefe9.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_1244abfa7fabc7cbae4b58480fcbefe9.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_78941bf1adb45f4bdd99d90da85b6b1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630f9d0>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_c2d45c78e4d276b13454333da3d4f42e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_c2d45c78e4d276b13454333da3d4f42e.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_d38f964560b3f1eba7851745b7926a1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e4850>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_78941bf1adb45f4bdd99d90da85b6b1e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_78941bf1adb45f4bdd99d90da85b6b1e.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_0e22056f6ab68f6a07b841e2804fd90d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6302cd0>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_d38f964560b3f1eba7851745b7926a1f.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_d38f964560b3f1eba7851745b7926a1f.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_7bd9dc6b67542114eea2e81f0f30d5f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8312390>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_0e22056f6ab68f6a07b841e2804fd90d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_0e22056f6ab68f6a07b841e2804fd90d.jpg saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_2c4032cdf1f7d47aedab9e9e3c4e8e89.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5906d50>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_7bd9dc6b67542114eea2e81f0f30d5f6.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_7bd9dc6b67542114eea2e81f0f30d5f6.jpg saved to cache
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_dd2bd7aad675e5fde6e4e9663d6a2107.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62c63d0>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_2c4032cdf1f7d47aedab9e9e3c4e8e89.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_2c4032cdf1f7d47aedab9e9e3c4e8e89.jpg saved to cache
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59e4850>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_dd2bd7aad675e5fde6e4e9663d6a2107.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_dd2bd7aad675e5fde6e4e9663d6a2107.jpg saved to cache
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f70322bd7b35cbb7f88f888a824f4c5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_201aa516b928520f6db75b979317874a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a46d0>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_f70322bd7b35cbb7f88f888a824f4c5a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f70322bd7b35cbb7f88f888a824f4c5a.jpg saved to cache
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_6485dcc6c648b23076e01de8eac98a4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6301f50>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Ff7%252Fdcf71414aa86a0beb3dc60426df7fb37%252Fpa%252FGG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg saved to cache
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54b9ce48-9f93-5779-9ced-aec521f516fb
2026-03-28 11:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54b9ce48-9f93-5779-9ced-aec521f516fb, skipping ID generation
2026-03-28 11:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54b9ce48-9f93-5779-9ced-aec521f516fb with scrape type 1
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54b9ce48-9f93-5779-9ced-aec521f516fb sending to next pipeline
2026-03-28 11:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 54b9ce48-9f93-5779-9ced-aec521f516fb, identifier: GG14536
2026-03-28 11:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 54b9ce48-9f93-5779-9ced-aec521f516fb with identifier: GG14536
2026-03-28 11:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 54b9ce48-9f93-5779-9ced-aec521f516fb with identifier: GG14536
2026-03-28 11:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 54b9ce48-9f93-5779-9ced-aec521f516fb with identifier: GG14536 to the API
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:02:36Z',
 'fuel_type': 'petrol',
 'id': '54b9ce48-9f93-5779-9ced-aec521f516fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG14536',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 186919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_3ee9b42af19ecb5658870334bf9a6cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_dd2bd7aad675e5fde6e4e9663d6a2107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_0e22056f6ab68f6a07b841e2804fd90d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_c2d45c78e4d276b13454333da3d4f42e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b4ddecc6cb08003e2d90e53a00ef9a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b9ce48-9f93-5779-9ced-aec521f516fb/54b9ce48-9f93-5779-9ced-aec521f516fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/f7/dcf71414aa86a0beb3dc60426df7fb37/pa/GG14536_b515921840725fbc8d2f0f06a0e8c64f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14536%27 HTTP/1.1" 200 None
2026-03-28 11:06:48 [auto1.es] INFO: Saving data for GG14536: {'created_time': 1774696008.961941, 'last_price_update_time': 1774696008.961951, 'auction_closing_time': 1774882956.0}
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GG14536') HTTP/1.1" 204 0
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f643e890>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F40%252Ffc40569a114cdded77d6ef9b61ea6bcc%252Fpa%252FNM22189_201aa516b928520f6db75b979317874a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_201aa516b928520f6db75b979317874a.jpg saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce88e9d8-6838-51f7-b591-2d6570fb85d1
2026-03-28 11:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce88e9d8-6838-51f7-b591-2d6570fb85d1, skipping ID generation
2026-03-28 11:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce88e9d8-6838-51f7-b591-2d6570fb85d1 with scrape type 1
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce88e9d8-6838-51f7-b591-2d6570fb85d1 sending to next pipeline
2026-03-28 11:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce88e9d8-6838-51f7-b591-2d6570fb85d1, identifier: NM22189
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c6590>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_6485dcc6c648b23076e01de8eac98a4e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_6485dcc6c648b23076e01de8eac98a4e.jpg saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce88e9d8-6838-51f7-b591-2d6570fb85d1 with identifier: NM22189
2026-03-28 11:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce88e9d8-6838-51f7-b591-2d6570fb85d1 with identifier: NM22189
2026-03-28 11:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce88e9d8-6838-51f7-b591-2d6570fb85d1 with identifier: NM22189 to the API
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_201aa516b928520f6db75b979317874a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:55Z',
 'fuel_type': 'petrol',
 'id': 'ce88e9d8-6838-51f7-b591-2d6570fb85d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM22189',
 'listing': 'auction',
 'location': 'ES, Cabrera de Mar',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 85959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_201aa516b928520f6db75b979317874a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f70322bd7b35cbb7f88f888a824f4c5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_7bd9dc6b67542114eea2e81f0f30d5f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_78941bf1adb45f4bdd99d90da85b6b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f18b06504c04c1e62d2f364b14556bb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_c3b9648c1ee05bacf9e612231ea50290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_f3648f46e9e278b09be9427307d8b96a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_05bbbe79984d199146a7d3c8fb5395e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_b2b6b413135e37f6b908782e978d1298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88e9d8-6838-51f7-b591-2d6570fb85d1/ce88e9d8-6838-51f7-b591-2d6570fb85d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/40/fc40569a114cdded77d6ef9b61ea6bcc/pa/NM22189_d21010d3464672b7fddc2850edb9da75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM22189%27 HTTP/1.1" 200 None
2026-03-28 11:06:49 [auto1.es] INFO: Saving data for NM22189: {'created_time': 1774696009.509704, 'last_price_update_time': 1774696009.509715, 'auction_closing_time': 1774886395.0}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM22189') HTTP/1.1" 204 0
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6461250>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fef%252Fe2efb376d5460e2bbff3b374bab3e119%252Fpa%252FPN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c
2026-03-28 11:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a58b22c-0b7e-53a0-8697-4dac9320e98c, skipping ID generation
2026-03-28 11:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c with scrape type 1
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a58b22c-0b7e-53a0-8697-4dac9320e98c sending to next pipeline
2026-03-28 11:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a58b22c-0b7e-53a0-8697-4dac9320e98c, identifier: PN86377
2026-03-28 11:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_c8449aa085341b51001877b06484e18c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a58b22c-0b7e-53a0-8697-4dac9320e98c with identifier: PN86377
2026-03-28 11:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a58b22c-0b7e-53a0-8697-4dac9320e98c with identifier: PN86377
2026-03-28 11:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a58b22c-0b7e-53a0-8697-4dac9320e98c with identifier: PN86377 to the API
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:09Z',
 'fuel_type': 'petrol',
 'id': '5a58b22c-0b7e-53a0-8697-4dac9320e98c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN86377',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 88833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_9d7a3ecc5524d1e79bf2a4b002981f6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_6485dcc6c648b23076e01de8eac98a4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_595d3509b496c1bbdf5a1888ceeccb87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_2c4032cdf1f7d47aedab9e9e3c4e8e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_d38f964560b3f1eba7851745b7926a1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a58b22c-0b7e-53a0-8697-4dac9320e98c/5a58b22c-0b7e-53a0-8697-4dac9320e98c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ef/e2efb376d5460e2bbff3b374bab3e119/pa/PN86377_1244abfa7fabc7cbae4b58480fcbefe9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 THP Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN86377%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [auto1.es] INFO: Saving data for PN86377: {'created_time': 1774696010.004788, 'last_price_update_time': 1774696010.004798, 'auction_closing_time': 1774884189.0}
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PN86377') HTTP/1.1" 204 0
2026-03-28 11:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6463b10>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_c8449aa085341b51001877b06484e18c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_c8449aa085341b51001877b06484e18c.jpg saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_046549d6b61b49a1d4d82cb35c0d8f37.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5a1d010>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_046549d6b61b49a1d4d82cb35c0d8f37.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_046549d6b61b49a1d4d82cb35c0d8f37.jpg saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_08b01c7a3b86496e62f386a2c291447b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62a4990>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F72%252Fcc724a08a690e170c4389edbac8b4d42%252Fpa%252FPL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04748421-d697-5e08-a5ce-d98486e83e22
2026-03-28 11:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04748421-d697-5e08-a5ce-d98486e83e22, skipping ID generation
2026-03-28 11:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04748421-d697-5e08-a5ce-d98486e83e22 with scrape type 1
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04748421-d697-5e08-a5ce-d98486e83e22 sending to next pipeline
2026-03-28 11:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 04748421-d697-5e08-a5ce-d98486e83e22, identifier: PL51206
2026-03-28 11:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 04748421-d697-5e08-a5ce-d98486e83e22 with identifier: PL51206
2026-03-28 11:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 04748421-d697-5e08-a5ce-d98486e83e22 with identifier: PL51206
2026-03-28 11:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 04748421-d697-5e08-a5ce-d98486e83e22 with identifier: PL51206 to the API
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:21:23Z',
 'fuel_type': 'diesel',
 'id': '04748421-d697-5e08-a5ce-d98486e83e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL51206',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 199358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ff60cc4f0a710217a447d36f6b672c6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_c8449aa085341b51001877b06484e18c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_ca8217cf5d5c01fbcae1efa9e4d78b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_189f6ad9beaf03b0af40a3875ca766be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_35a28321063c426acbe9489c9b824812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04748421-d697-5e08-a5ce-d98486e83e22/04748421-d697-5e08-a5ce-d98486e83e22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/72/cc724a08a690e170c4389edbac8b4d42/pa/PL51206_1ac0f569a5c81f52fd27831045ac8238.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2009}
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL51206%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [auto1.es] INFO: Saving data for PL51206: {'created_time': 1774696010.730944, 'last_price_update_time': 1774696010.730954, 'auction_closing_time': 1774884083.0}
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PL51206') HTTP/1.1" 204 0
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_1368c7fc42ce9bbd3481951765991ef5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f594f7d0>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F59%252Fb45922501eb59752a7bf24aa0c36e4fb%252Fpa%252FGZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4403fc59-59a8-56aa-8a58-fd078cbc3802
2026-03-28 11:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4403fc59-59a8-56aa-8a58-fd078cbc3802, skipping ID generation
2026-03-28 11:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4403fc59-59a8-56aa-8a58-fd078cbc3802 with scrape type 1
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4403fc59-59a8-56aa-8a58-fd078cbc3802 sending to next pipeline
2026-03-28 11:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4403fc59-59a8-56aa-8a58-fd078cbc3802, identifier: GZ44796
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f87cdd50>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_08b01c7a3b86496e62f386a2c291447b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_08b01c7a3b86496e62f386a2c291447b.jpg saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4403fc59-59a8-56aa-8a58-fd078cbc3802 with identifier: GZ44796
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4403fc59-59a8-56aa-8a58-fd078cbc3802 with identifier: GZ44796
2026-03-28 11:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4403fc59-59a8-56aa-8a58-fd078cbc3802 with identifier: GZ44796 to the API
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': '4403fc59-59a8-56aa-8a58-fd078cbc3802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ44796',
 'listing': 'auction',
 'location': 'ES, Santa Ana',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 223309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_3adfc0e4271edc268b8547a56ffc5387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_046549d6b61b49a1d4d82cb35c0d8f37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_45ff52b9d4f144e661d77256f456edaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_aee525052dfb946011dc374425ba5167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_5283827732a794e4083fc2ddf4e7eabe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4403fc59-59a8-56aa-8a58-fd078cbc3802/4403fc59-59a8-56aa-8a58-fd078cbc3802_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/59/b45922501eb59752a7bf24aa0c36e4fb/pa/GZ44796_edea96a2552fe94a55a744b7068e5368.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2006}
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ44796%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [auto1.es] INFO: Saving data for GZ44796: {'created_time': 1774696011.396627, 'last_price_update_time': 1774696011.396638, 'auction_closing_time': 1774885963.0}
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GZ44796') HTTP/1.1" 204 0
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT45272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP23641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82f4490>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_1368c7fc42ce9bbd3481951765991ef5.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_1368c7fc42ce9bbd3481951765991ef5.jpg saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_89848a4bacbafb325a36ee36b095b994.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_f68db7a64be686f4b41ff63441c485bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f64310d0>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_89848a4bacbafb325a36ee36b095b994.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_89848a4bacbafb325a36ee36b095b994.jpg saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6317ad0>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe5%252Feae557e783ddda95fadf68cb8e9f9053%252Fpa%252FRR07700_f68db7a64be686f4b41ff63441c485bc.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_f68db7a64be686f4b41ff63441c485bc.jpg saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1933d201-586e-5488-9e85-4a087cfd7e25
2026-03-28 11:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1933d201-586e-5488-9e85-4a087cfd7e25, skipping ID generation
2026-03-28 11:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1933d201-586e-5488-9e85-4a087cfd7e25 with scrape type 1
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1933d201-586e-5488-9e85-4a087cfd7e25 sending to next pipeline
2026-03-28 11:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1933d201-586e-5488-9e85-4a087cfd7e25, identifier: RR07700
2026-03-28 11:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1933d201-586e-5488-9e85-4a087cfd7e25 with identifier: RR07700
2026-03-28 11:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1933d201-586e-5488-9e85-4a087cfd7e25 with identifier: RR07700
2026-03-28 11:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1933d201-586e-5488-9e85-4a087cfd7e25 with identifier: RR07700 to the API
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_f68db7a64be686f4b41ff63441c485bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:37:58Z',
 'fuel_type': 'diesel',
 'id': '1933d201-586e-5488-9e85-4a087cfd7e25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR07700',
 'listing': 'auction',
 'location': 'ES, Alzira',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 239618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_f68db7a64be686f4b41ff63441c485bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_172ff6f9e986f843be6ad63f4782fc28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_08b01c7a3b86496e62f386a2c291447b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_ddf60ab446bab9709beb1cde7ed26d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_51fc20b10f71c26b50690fcdfe4457f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1933d201-586e-5488-9e85-4a087cfd7e25/1933d201-586e-5488-9e85-4a087cfd7e25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e5/eae557e783ddda95fadf68cb8e9f9053/pa/RR07700_6bed4e0a67b7aafa76c88a4bb631536b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR07700%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Saving data for RR07700: {'created_time': 1774696012.171654, 'last_price_update_time': 1774696012.171664, 'auction_closing_time': 1774885078.0}
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RR07700') HTTP/1.1" 204 0
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_6c6622f2722faad91e86871a9c197900.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5906f90>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F16%252F92168ef1172dc5d1a81c3373cf6f7d11%252Fpa%252FBM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73fb821f-6c19-5407-b8eb-25468f06eaad
2026-03-28 11:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73fb821f-6c19-5407-b8eb-25468f06eaad, skipping ID generation
2026-03-28 11:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73fb821f-6c19-5407-b8eb-25468f06eaad with scrape type 1
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73fb821f-6c19-5407-b8eb-25468f06eaad sending to next pipeline
2026-03-28 11:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73fb821f-6c19-5407-b8eb-25468f06eaad, identifier: BM94316
2026-03-28 11:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73fb821f-6c19-5407-b8eb-25468f06eaad with identifier: BM94316
2026-03-28 11:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73fb821f-6c19-5407-b8eb-25468f06eaad with identifier: BM94316
2026-03-28 11:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73fb821f-6c19-5407-b8eb-25468f06eaad with identifier: BM94316 to the API
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:52Z',
 'fuel_type': 'diesel',
 'id': '73fb821f-6c19-5407-b8eb-25468f06eaad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM94316',
 'listing': 'auction',
 'location': 'ES, Castelló de la Plana',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 218912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_4fc8465a1484a5995fbebb11d7e0ff67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_89848a4bacbafb325a36ee36b095b994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_1368c7fc42ce9bbd3481951765991ef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_8cc247c790615c1b94d5f8f9349bbb0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_7678dafb0fee89c6ee4d16581f27ba93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fb821f-6c19-5407-b8eb-25468f06eaad/73fb821f-6c19-5407-b8eb-25468f06eaad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/16/92168ef1172dc5d1a81c3373cf6f7d11/pa/BM94316_6da1346bd0ddee10527c302e644cb5f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Altea 1.6 TDI Reference Ecomotive',
 'transmission': 'manual',
 'trim': 'Reference Ecomotive',
 'year': 2012}
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM94316%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Saving data for BM94316: {'created_time': 1774696012.677459, 'last_price_update_time': 1774696012.677469, 'auction_closing_time': 1774883332.0}
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM94316') HTTP/1.1" 204 0
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM88527> (referer: https://www.auto1.com/v1/car-details-view/EM88527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_8116a2a683681ee7b214e0c391c005d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82f7290>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd77e97-e526-57a7-8404-362f17856991/fcd77e97-e526-57a7-8404-362f17856991_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F12%252F7012b4f37df25ce20fd02e59f0121c3a%252Fpa%252FRE29158_6c6622f2722faad91e86871a9c197900.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_6c6622f2722faad91e86871a9c197900.jpg saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcd77e97-e526-57a7-8404-362f17856991
2026-03-28 11:06:52 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2559 | hits on page: 40
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG57096%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for AG57096: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU80612%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for PU80612: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH02704%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for GH02704: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH62909%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for ZH62909: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: GC12558
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC12558%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for GC12558: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: KD17519
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: UZ29384
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ29384%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for UZ29384: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: KA03965
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: WN30367
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: FC18044
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: EE40480
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: ZU46399
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: KY80374
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY80374%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for KY80374: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: ZB60783
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB60783%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for ZB60783: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ74298%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for YZ74298: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK64988%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for YK64988: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: YJ21148
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ21148%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for YJ21148: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN99288%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for XN99288: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: XJ10709
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA46112%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for XA46112: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ01367%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [auto1.es] INFO: Scrape type for WZ01367: 0
2026-03-28 11:06:52 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY32728%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [auto1.es] INFO: Scrape type for WY32728: 0
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB05226%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [auto1.es] INFO: Scrape type for WB05226: 0
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: UG63824
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: VN92825
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN92825%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [auto1.es] INFO: Scrape type for VN92825: 0
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: ZF31827
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF31827%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [auto1.es] INFO: Scrape type for ZF31827: 0
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: US42967
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US42967%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [auto1.es] INFO: Scrape type for US42967: 0
2026-03-28 11:06:53 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-28 11:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA65207> (referer: https://www.auto1.com/v1/car-details-view/WA65207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f647084e-3229-5ebc-9151-af0876c693c9 with identifier: EM88527
2026-03-28 11:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f647084e-3229-5ebc-9151-af0876c693c9 with scrape type 1
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_317a3f6b6f1c3f113d3d925519a85b72.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_317a3f6b6f1c3f113d3d925519a85b72.jpg not downloaded yet
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63fe750>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_8116a2a683681ee7b214e0c391c005d7.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_8116a2a683681ee7b214e0c391c005d7.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26591f7a-c0d4-563a-8053-ea96c484618f
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_6847f1327747cbed8da0590554dffe2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_6847f1327747cbed8da0590554dffe2c.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_dbba37ad05adf388027a0f4a9bd565a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_dbba37ad05adf388027a0f4a9bd565a4.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_13b9f0e8b9e627e213acf1b80ab5de25.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_13b9f0e8b9e627e213acf1b80ab5de25.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_200d5de2b6acef7210f992033c7e2bad.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_200d5de2b6acef7210f992033c7e2bad.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b8b9b70dc65d921b592590b05362a46b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f593aa90>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26591f7a-c0d4-563a-8053-ea96c484618f
2026-03-28 11:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 with identifier: WA65207
2026-03-28 11:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 with scrape type 1
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_3b9cbdd1fbbd95af3c5c5ff9b8fc7706.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_3b9cbdd1fbbd95af3c5c5ff9b8fc7706.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_933c8fbcc73c6a7a5a135f4ef4775e5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_933c8fbcc73c6a7a5a135f4ef4775e5c.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_62e1b18e0826a5bfa0fdbee2fb79c0f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_62e1b18e0826a5bfa0fdbee2fb79c0f1.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_b896b536e691eaf58eb19b0f356082d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_b896b536e691eaf58eb19b0f356082d1.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_c4acd1e874a73953f1a6ee92c4d94c6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_c4acd1e874a73953f1a6ee92c4d94c6a.jpg not downloaded yet
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f640cc90>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_b8b9b70dc65d921b592590b05362a46b.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b8b9b70dc65d921b592590b05362a46b.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26591f7a-c0d4-563a-8053-ea96c484618f
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_8cba7be0a8964191767b3358d28564f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_8cba7be0a8964191767b3358d28564f0.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_fdb71fa295a73221125faa62b14e86d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_79c34ce6806187e224509bafc2e199c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_79c34ce6806187e224509bafc2e199c8.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_f913fe91f4644d04bb9748366b24e2df.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_f913fe91f4644d04bb9748366b24e2df.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_8b87e3da740b9af3735a3f6b5f71f74d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_8b87e3da740b9af3735a3f6b5f71f74d.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_50682362b275b00d243686b24a17afef.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_50682362b275b00d243686b24a17afef.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_d6cbd89be5263a631d70082081d634b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_d6cbd89be5263a631d70082081d634b1.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_317a3f6b6f1c3f113d3d925519a85b72.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_24a2c8e774d5166386390185fe4ffb1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_24a2c8e774d5166386390185fe4ffb1a.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_99de53606268ad09ea70820be115d336.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_99de53606268ad09ea70820be115d336.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP23641> (referer: https://www.auto1.com/v1/car-details-view/KP23641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_dc97ea96f2a2de241aa3263f969eff30.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_dc97ea96f2a2de241aa3263f969eff30.jpg not downloaded yet
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f2910>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa3%252F82a3458155fc10fe4413d7fd300d0757%252Fpa%252FLJ76741_fdb71fa295a73221125faa62b14e86d7.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_fdb71fa295a73221125faa62b14e86d7.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26591f7a-c0d4-563a-8053-ea96c484618f
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_6847f1327747cbed8da0590554dffe2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f8313410>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_317a3f6b6f1c3f113d3d925519a85b72.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_317a3f6b6f1c3f113d3d925519a85b72.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d23cd5b-f98a-554b-a344-58a34733cb30 with identifier: KP23641
2026-03-28 11:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d23cd5b-f98a-554b-a344-58a34733cb30 with scrape type 1
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_3d4fc58fa5be66120e3771e482aea47a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3d4fc58fa5be66120e3771e482aea47a.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_dbba37ad05adf388027a0f4a9bd565a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_e2753a4e60b23636130b17ff32fe0a22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e2753a4e60b23636130b17ff32fe0a22.jpg not downloaded yet
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ff910>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_6847f1327747cbed8da0590554dffe2c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_6847f1327747cbed8da0590554dffe2c.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_2bcc52cfafdaccfdc51e4258d5adfd21.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_2bcc52cfafdaccfdc51e4258d5adfd21.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_13b9f0e8b9e627e213acf1b80ab5de25.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_bff0e060e91ba8fb1b2ea8e1e832b4d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_bff0e060e91ba8fb1b2ea8e1e832b4d8.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_daccf87778714c0cfb2f31ae5914bcfc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_daccf87778714c0cfb2f31ae5914bcfc.jpg not downloaded yet
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f597f050>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_dbba37ad05adf388027a0f4a9bd565a4.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_dbba37ad05adf388027a0f4a9bd565a4.jpg saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ60367> (referer: https://www.auto1.com/v1/car-details-view/AZ60367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_e19345f4713c88c6e4e89927f38966dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e19345f4713c88c6e4e89927f38966dd.jpg not downloaded yet
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_c4acd1e874a73953f1a6ee92c4d94c6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_e3648c768e2a78116ae1569cea45d0f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e3648c768e2a78116ae1569cea45d0f7.jpg not downloaded yet
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_30f23c94097c7ad0a2962c685ee96531.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_30f23c94097c7ad0a2962c685ee96531.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_3a4f9ea644840ebca85d88dacd3256d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3a4f9ea644840ebca85d88dacd3256d0.jpg not downloaded yet
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT45272> (referer: https://www.auto1.com/v1/car-details-view/ZT45272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f3390>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_13b9f0e8b9e627e213acf1b80ab5de25.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_13b9f0e8b9e627e213acf1b80ab5de25.jpg saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_d6cbd89be5263a631d70082081d634b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11938754-3c1e-5f6f-ba0a-d76b435101f8 with identifier: AZ60367
2026-03-28 11:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11938754-3c1e-5f6f-ba0a-d76b435101f8 with scrape type 1
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_4ba74bef3b6e494c47664497aa949a57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_4ba74bef3b6e494c47664497aa949a57.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_005b4da0311df28eb71e9bc0c61db5f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_005b4da0311df28eb71e9bc0c61db5f8.jpg not downloaded yet
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f645ae10>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_c4acd1e874a73953f1a6ee92c4d94c6a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_c4acd1e874a73953f1a6ee92c4d94c6a.jpg saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_47f9aa7353eac181df36ca115ee21853.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_47f9aa7353eac181df36ca115ee21853.jpg not downloaded yet
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_99de53606268ad09ea70820be115d336.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_e0821d650c7028df580a33df2be2c5a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_e0821d650c7028df580a33df2be2c5a0.jpg not downloaded yet
2026-03-28 11:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 with identifier: ZT45272
2026-03-28 11:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 with scrape type 1
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_12f96071a8b8083294988d8f1e72661d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_12f96071a8b8083294988d8f1e72661d.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_0d160ef84c8d14c478ed9000357e1958.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_0d160ef84c8d14c478ed9000357e1958.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_7b880ed1c40d10097f133fe8007d4548.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_7b880ed1c40d10097f133fe8007d4548.jpg not downloaded yet
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ffc50>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_d6cbd89be5263a631d70082081d634b1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_d6cbd89be5263a631d70082081d634b1.jpg saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_dc97ea96f2a2de241aa3263f969eff30.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_ad85df09b87158e8450257462ccb582c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ad85df09b87158e8450257462ccb582c.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_14db69bdcd61f5f2fb091cac7df05899.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_14db69bdcd61f5f2fb091cac7df05899.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_db432b33ce27facbd51c4e25849aa43c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_db432b33ce27facbd51c4e25849aa43c.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_1a2ceee52630b127cb6e5ee8a88660d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_1a2ceee52630b127cb6e5ee8a88660d1.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_1f224ee32863ab2951ce65de795da389.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_1f224ee32863ab2951ce65de795da389.jpg not downloaded yet
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59391d0>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_99de53606268ad09ea70820be115d336.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_99de53606268ad09ea70820be115d336.jpg saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_6506d11237a8958721218a814ab31b41.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_6506d11237a8958721218a814ab31b41.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_ae33b704d67b9dc78726128628e501a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ae33b704d67b9dc78726128628e501a0.jpg not downloaded yet
2026-03-28 11:06:54 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2559 | hits on page: 40
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3d4fc58fa5be66120e3771e482aea47a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_279e1b988495f3de80cfa2db9e8019dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_279e1b988495f3de80cfa2db9e8019dd.jpg not downloaded yet
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_315ffc48ee7a540c795e5f15d2c79d96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_315ffc48ee7a540c795e5f15d2c79d96.jpg not downloaded yet
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG79405%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for TG79405: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE76337%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for TE76337: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: TA28107
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST22726%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for ST22726: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP63286%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for SP63286: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY07165%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for RY07165: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: RW95196
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV56765%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for NV56765: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN81936%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for NN81936: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: MY70573
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY70573%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for MY70573: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: MK40110
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK40110%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for MK40110: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: MH26986
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH26986%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for MH26986: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD02288%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for MD02288: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: LB98236
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB98236%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for LB98236: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: KS49101
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: BP62909
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: WX65667
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: KG64862
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: JH20520
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG48293%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for JG48293: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY05176%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for HY05176: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: HS16783
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU63395%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for GU63395: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF03006%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for FF03006: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: ZC89924
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC89924%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for ZC89924: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: GG25367
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG25367%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for GG25367: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: DP25407
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: DK84530
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK84530%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for DK84530: 0
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: DA34645
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-28 11:06:54 [auto1.es] INFO: Found listing with ID: CC07404
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC07404%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [auto1.es] INFO: Scrape type for CC07404: 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_d3a33754a4f7b370937d519066f4e5f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_d3a33754a4f7b370937d519066f4e5f2.jpg not downloaded yet
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f634a890>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_dc97ea96f2a2de241aa3263f969eff30.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_dc97ea96f2a2de241aa3263f969eff30.jpg saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e2753a4e60b23636130b17ff32fe0a22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_470b1d153a066cb541247c3fd1d1ca52.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_470b1d153a066cb541247c3fd1d1ca52.jpg not downloaded yet
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f648ef10>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_3d4fc58fa5be66120e3771e482aea47a.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3d4fc58fa5be66120e3771e482aea47a.jpg saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_89d2a3532a09c9486d4751ef19a12313.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_89d2a3532a09c9486d4751ef19a12313.jpg not downloaded yet
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_b5f291b42418009132bdd46a039523b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_b5f291b42418009132bdd46a039523b7.jpg not downloaded yet
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63312d0>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_e2753a4e60b23636130b17ff32fe0a22.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e2753a4e60b23636130b17ff32fe0a22.jpg saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_daccf87778714c0cfb2f31ae5914bcfc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f640e7d0>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_daccf87778714c0cfb2f31ae5914bcfc.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_daccf87778714c0cfb2f31ae5914bcfc.jpg saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_bff0e060e91ba8fb1b2ea8e1e832b4d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6330390>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_bff0e060e91ba8fb1b2ea8e1e832b4d8.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_bff0e060e91ba8fb1b2ea8e1e832b4d8.jpg saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3a4f9ea644840ebca85d88dacd3256d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_30f23c94097c7ad0a2962c685ee96531.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f640e090>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_3a4f9ea644840ebca85d88dacd3256d0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3a4f9ea644840ebca85d88dacd3256d0.jpg saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_005b4da0311df28eb71e9bc0c61db5f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6451b50>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_30f23c94097c7ad0a2962c685ee96531.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_30f23c94097c7ad0a2962c685ee96531.jpg saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6460b90>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_005b4da0311df28eb71e9bc0c61db5f8.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_005b4da0311df28eb71e9bc0c61db5f8.jpg saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_7b880ed1c40d10097f133fe8007d4548.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_0d160ef84c8d14c478ed9000357e1958.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6330190>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_7b880ed1c40d10097f133fe8007d4548.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_7b880ed1c40d10097f133fe8007d4548.jpg saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_6506d11237a8958721218a814ab31b41.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6389cd0>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_0d160ef84c8d14c478ed9000357e1958.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_0d160ef84c8d14c478ed9000357e1958.jpg saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f630c110>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_6506d11237a8958721218a814ab31b41.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_6506d11237a8958721218a814ab31b41.jpg saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_d3a33754a4f7b370937d519066f4e5f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85e0c50>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_d3a33754a4f7b370937d519066f4e5f2.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_d3a33754a4f7b370937d519066f4e5f2.jpg saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_b5f291b42418009132bdd46a039523b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ae650>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_b5f291b42418009132bdd46a039523b7.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_b5f291b42418009132bdd46a039523b7.jpg saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_89d2a3532a09c9486d4751ef19a12313.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_470b1d153a066cb541247c3fd1d1ca52.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6388e10>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_89d2a3532a09c9486d4751ef19a12313.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_89d2a3532a09c9486d4751ef19a12313.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c7750>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_470b1d153a066cb541247c3fd1d1ca52.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_470b1d153a066cb541247c3fd1d1ca52.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_315ffc48ee7a540c795e5f15d2c79d96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_279e1b988495f3de80cfa2db9e8019dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6329090>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_315ffc48ee7a540c795e5f15d2c79d96.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_315ffc48ee7a540c795e5f15d2c79d96.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ae33b704d67b9dc78726128628e501a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82f6b90>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_279e1b988495f3de80cfa2db9e8019dd.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_279e1b988495f3de80cfa2db9e8019dd.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_1f224ee32863ab2951ce65de795da389.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:57 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2559 | hits on page: 40
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET28977%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for ET28977: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: BP46886
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ99702%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for BJ99702: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE81339%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for BE81339: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: AU19829
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: XB68205
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: FG81447
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG81447%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for FG81447: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: VV50506
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV50506%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for VV50506: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: VV40051
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: NZ10183
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ10183%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for NZ10183: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: EY94585
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY94585%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for EY94585: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: ZM37392
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37392%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for ZM37392: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: YV41467
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV41467%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for YV41467: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: VZ90970
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: MR39300
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: JR92140
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: HK98944
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK98944%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for HK98944: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: HD07972
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: GX01105
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: CW13778
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW13778%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for CW13778: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG01013%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for VG01013: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: MB17982
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB17982%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for MB17982: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: FK59567
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK59567%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for FK59567: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: UP38742
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP38742%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for UP38742: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: EP70954
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP70954%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for EP70954: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: CR30335
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ83814%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for WJ83814: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: XW01779
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: LA45475
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: KU66562
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: RU59463
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU59463%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for RU59463: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: BA49361
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: ZY46738
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: JZ17995
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: ND95475
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND95475%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for ND95475: 0
2026-03-28 11:06:57 [auto1.es] INFO: Found listing with ID: FJ32938
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ32938%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [auto1.es] INFO: Scrape type for FJ32938: 0
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_1a2ceee52630b127cb6e5ee8a88660d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6463190>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_ae33b704d67b9dc78726128628e501a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ae33b704d67b9dc78726128628e501a0.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63af590>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_1f224ee32863ab2951ce65de795da389.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_1f224ee32863ab2951ce65de795da389.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63ad2d0>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_1a2ceee52630b127cb6e5ee8a88660d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_1a2ceee52630b127cb6e5ee8a88660d1.jpg saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_db432b33ce27facbd51c4e25849aa43c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_14db69bdcd61f5f2fb091cac7df05899.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6509a50>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_db432b33ce27facbd51c4e25849aa43c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_db432b33ce27facbd51c4e25849aa43c.jpg saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ad85df09b87158e8450257462ccb582c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6300110>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_14db69bdcd61f5f2fb091cac7df05899.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_14db69bdcd61f5f2fb091cac7df05899.jpg saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_12f96071a8b8083294988d8f1e72661d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_e0821d650c7028df580a33df2be2c5a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f632b190>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_ad85df09b87158e8450257462ccb582c.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ad85df09b87158e8450257462ccb582c.jpg saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6569990>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F05%252F61059f5177318a40e2bb61a2061b1b5a%252Fpa%252FZT45272_12f96071a8b8083294988d8f1e72661d.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_12f96071a8b8083294988d8f1e72661d.jpg saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3
2026-03-28 11:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d8526ba-5ea9-57da-ad4d-71e39085b2c3, skipping ID generation
2026-03-28 11:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 with scrape type 1
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 sending to next pipeline
2026-03-28 11:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d8526ba-5ea9-57da-ad4d-71e39085b2c3, identifier: ZT45272
2026-03-28 11:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 with identifier: ZT45272
2026-03-28 11:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 with identifier: ZT45272
2026-03-28 11:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d8526ba-5ea9-57da-ad4d-71e39085b2c3 with identifier: ZT45272 to the API
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_12f96071a8b8083294988d8f1e72661d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:52:23Z',
 'fuel_type': 'petrol',
 'id': '4d8526ba-5ea9-57da-ad4d-71e39085b2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT45272',
 'listing': 'auction',
 'location': 'ES, La Linea, Cadiz',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 57220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_12f96071a8b8083294988d8f1e72661d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_7b880ed1c40d10097f133fe8007d4548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_14db69bdcd61f5f2fb091cac7df05899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_1a2ceee52630b127cb6e5ee8a88660d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_6506d11237a8958721218a814ab31b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_279e1b988495f3de80cfa2db9e8019dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_d3a33754a4f7b370937d519066f4e5f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_470b1d153a066cb541247c3fd1d1ca52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_89d2a3532a09c9486d4751ef19a12313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8526ba-5ea9-57da-ad4d-71e39085b2c3/4d8526ba-5ea9-57da-ad4d-71e39085b2c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/05/61059f5177318a40e2bb61a2061b1b5a/pa/ZT45272_b5f291b42418009132bdd46a039523b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2014}
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT45272%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Saving data for ZT45272: {'created_time': 1774696019.207434, 'last_price_update_time': 1774696019.207447, 'auction_closing_time': 1774885943.0}
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT45272') HTTP/1.1" 204 0
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_47f9aa7353eac181df36ca115ee21853.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59f8dd0>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_e0821d650c7028df580a33df2be2c5a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_e0821d650c7028df580a33df2be2c5a0.jpg saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_4ba74bef3b6e494c47664497aa949a57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6389550>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_47f9aa7353eac181df36ca115ee21853.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_47f9aa7353eac181df36ca115ee21853.jpg saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:59 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2559 | hits on page: 40
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: LZ97772
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ97772%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for LZ97772: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: NW02170
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW02170%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for NW02170: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: BR53004
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR53004%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for BR53004: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: AS54337
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS54337%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for AS54337: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV75612%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for CV75612: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: TR12651
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR12651%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for TR12651: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: XS66014
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS66014%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for XS66014: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: RP64804
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ95909%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for SZ95909: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: LW26471
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: HJ68220
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ68220%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for HJ68220: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: ZZ18743
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ18743%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for ZZ18743: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: UF55082
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: RP55294
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: ZR84162
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: YG81758
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: XZ87449
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ87449%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for XZ87449: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: VL98218
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: BE62587
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: SN94812
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN94812%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for SN94812: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: TE16269
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE16269%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for TE16269: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: VH11492
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH11492%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for VH11492: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: RK33204
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU25614%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for HU25614: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: FC36055
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV92160%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for UV92160: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES45064%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for ES45064: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: NF35716
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF35716%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for NF35716: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: VU00284
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL83097%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [auto1.es] INFO: Scrape type for BL83097: 0
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: UB71741
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-28 11:06:59 [auto1.es] INFO: Found listing with ID: MW97614
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e3648c768e2a78116ae1569cea45d0f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63c4190>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F3c%252F863c4c661f7ca0083fa6a71f62e6aee0%252Fpa%252FAZ60367_4ba74bef3b6e494c47664497aa949a57.jpg') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_4ba74bef3b6e494c47664497aa949a57.jpg saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11938754-3c1e-5f6f-ba0a-d76b435101f8
2026-03-28 11:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11938754-3c1e-5f6f-ba0a-d76b435101f8, skipping ID generation
2026-03-28 11:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11938754-3c1e-5f6f-ba0a-d76b435101f8 with scrape type 1
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11938754-3c1e-5f6f-ba0a-d76b435101f8 sending to next pipeline
2026-03-28 11:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 11938754-3c1e-5f6f-ba0a-d76b435101f8, identifier: AZ60367
2026-03-28 11:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 11938754-3c1e-5f6f-ba0a-d76b435101f8 with identifier: AZ60367
2026-03-28 11:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 11938754-3c1e-5f6f-ba0a-d76b435101f8 with identifier: AZ60367
2026-03-28 11:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 11938754-3c1e-5f6f-ba0a-d76b435101f8 with identifier: AZ60367 to the API
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_4ba74bef3b6e494c47664497aa949a57.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:37:48Z',
 'fuel_type': 'diesel',
 'id': '11938754-3c1e-5f6f-ba0a-d76b435101f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ60367',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 200539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_4ba74bef3b6e494c47664497aa949a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_005b4da0311df28eb71e9bc0c61db5f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_47f9aa7353eac181df36ca115ee21853.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_e0821d650c7028df580a33df2be2c5a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_0d160ef84c8d14c478ed9000357e1958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ad85df09b87158e8450257462ccb582c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_db432b33ce27facbd51c4e25849aa43c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_1f224ee32863ab2951ce65de795da389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_ae33b704d67b9dc78726128628e501a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11938754-3c1e-5f6f-ba0a-d76b435101f8/11938754-3c1e-5f6f-ba0a-d76b435101f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/3c/863c4c661f7ca0083fa6a71f62e6aee0/pa/AZ60367_315ffc48ee7a540c795e5f15d2c79d96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ60367%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [auto1.es] INFO: Saving data for AZ60367: {'created_time': 1774696020.351672, 'last_price_update_time': 1774696020.351684, 'auction_closing_time': 1774885068.0}
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AZ60367') HTTP/1.1" 204 0
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e19345f4713c88c6e4e89927f38966dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f63dd590>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_e3648c768e2a78116ae1569cea45d0f7.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e3648c768e2a78116ae1569cea45d0f7.jpg saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85deed0>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_e19345f4713c88c6e4e89927f38966dd.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e19345f4713c88c6e4e89927f38966dd.jpg saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_2bcc52cfafdaccfdc51e4258d5adfd21.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f638a4d0>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_2bcc52cfafdaccfdc51e4258d5adfd21.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_2bcc52cfafdaccfdc51e4258d5adfd21.jpg saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_24a2c8e774d5166386390185fe4ffb1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f62f3390>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F40%252Fdc4022ddc1cf783c7da94226bab4e36e%252Fpa%252FKP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d23cd5b-f98a-554b-a344-58a34733cb30
2026-03-28 11:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d23cd5b-f98a-554b-a344-58a34733cb30, skipping ID generation
2026-03-28 11:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d23cd5b-f98a-554b-a344-58a34733cb30 with scrape type 1
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d23cd5b-f98a-554b-a344-58a34733cb30 sending to next pipeline
2026-03-28 11:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d23cd5b-f98a-554b-a344-58a34733cb30, identifier: KP23641
2026-03-28 11:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d23cd5b-f98a-554b-a344-58a34733cb30 with identifier: KP23641
2026-03-28 11:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d23cd5b-f98a-554b-a344-58a34733cb30 with identifier: KP23641
2026-03-28 11:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d23cd5b-f98a-554b-a344-58a34733cb30 with identifier: KP23641 to the API
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'diesel',
 'id': '0d23cd5b-f98a-554b-a344-58a34733cb30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP23641',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 139493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3d4fc58fa5be66120e3771e482aea47a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_0aaac8136b68e0e92dc3ce1f28eb0d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e2753a4e60b23636130b17ff32fe0a22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_2bcc52cfafdaccfdc51e4258d5adfd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_bff0e060e91ba8fb1b2ea8e1e832b4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_daccf87778714c0cfb2f31ae5914bcfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e19345f4713c88c6e4e89927f38966dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_e3648c768e2a78116ae1569cea45d0f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_30f23c94097c7ad0a2962c685ee96531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d23cd5b-f98a-554b-a344-58a34733cb30/0d23cd5b-f98a-554b-a344-58a34733cb30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/40/dc4022ddc1cf783c7da94226bab4e36e/pa/KP23641_3a4f9ea644840ebca85d88dacd3256d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Altea 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2012}
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP23641%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Saving data for KP23641: {'created_time': 1774696021.513324, 'last_price_update_time': 1774696021.513334, 'auction_closing_time': 1774885184.0}
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP23641') HTTP/1.1" 204 0
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_50682362b275b00d243686b24a17afef.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5938ed0>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_24a2c8e774d5166386390185fe4ffb1a.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_24a2c8e774d5166386390185fe4ffb1a.jpg saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6452d50>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_50682362b275b00d243686b24a17afef.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_50682362b275b00d243686b24a17afef.jpg saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_8b87e3da740b9af3735a3f6b5f71f74d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:01 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: YS92814
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS92814%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for YS92814: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: AX08596
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX08596%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for AX08596: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC60196%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for XC60196: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG18454%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for ZG18454: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: JD79732
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: DK89612
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK89612%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for DK89612: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: WW09022
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW09022%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for WW09022: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: GC12859
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC12859%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for GC12859: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: KF74515
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: EE62782
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE62782%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for EE62782: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT10361%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for YT10361: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: MZ62170
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ62170%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for MZ62170: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: RC06010
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN02005%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for ZN02005: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: FG15461
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: AJ03756
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ03756%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for AJ03756: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: YY10601
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB32148%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for GB32148: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: SJ07079
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ07079%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for SJ07079: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: JK63504
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: DE75422
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: RN59573
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59573%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for RN59573: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: MS33551
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS33551%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for MS33551: 0
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: ZX65175
2026-03-28 11:07:01 [auto1.es] INFO: Found listing with ID: DW68520
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW68520%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [auto1.es] INFO: Scrape type for DW68520: 0
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_f913fe91f4644d04bb9748366b24e2df.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59fa450>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_8b87e3da740b9af3735a3f6b5f71f74d.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_8b87e3da740b9af3735a3f6b5f71f74d.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_79c34ce6806187e224509bafc2e199c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f640ddd0>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_f913fe91f4644d04bb9748366b24e2df.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_f913fe91f4644d04bb9748366b24e2df.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_8cba7be0a8964191767b3358d28564f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59301d0>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_79c34ce6806187e224509bafc2e199c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_79c34ce6806187e224509bafc2e199c8.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_b896b536e691eaf58eb19b0f356082d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f82fc410>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_8cba7be0a8964191767b3358d28564f0.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_8cba7be0a8964191767b3358d28564f0.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6509f50>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_b896b536e691eaf58eb19b0f356082d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_b896b536e691eaf58eb19b0f356082d1.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_62e1b18e0826a5bfa0fdbee2fb79c0f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_933c8fbcc73c6a7a5a135f4ef4775e5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6475310>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_62e1b18e0826a5bfa0fdbee2fb79c0f1.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_62e1b18e0826a5bfa0fdbee2fb79c0f1.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_3b9cbdd1fbbd95af3c5c5ff9b8fc7706.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f6333710>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_933c8fbcc73c6a7a5a135f4ef4775e5c.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_933c8fbcc73c6a7a5a135f4ef4775e5c.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f59f8e50>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_3b9cbdd1fbbd95af3c5c5ff9b8fc7706.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_3b9cbdd1fbbd95af3c5c5ff9b8fc7706.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_200d5de2b6acef7210f992033c7e2bad.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f85dfd10>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F32%252F82324a2c89666b2ee5644b2728612efa%252Fpa%252FWA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9
2026-03-28 11:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9, skipping ID generation
2026-03-28 11:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 with scrape type 1
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 sending to next pipeline
2026-03-28 11:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9, identifier: WA65207
2026-03-28 11:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 with identifier: WA65207
2026-03-28 11:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 with identifier: WA65207
2026-03-28 11:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9 with identifier: WA65207 to the API
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:55Z',
 'fuel_type': 'diesel',
 'id': '5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA65207',
 'listing': 'auction',
 'location': 'ES, Logroño',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 191779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_4b0cbffef20a58b92607d11e36b80bbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_933c8fbcc73c6a7a5a135f4ef4775e5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_b896b536e691eaf58eb19b0f356082d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_8cba7be0a8964191767b3358d28564f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_f913fe91f4644d04bb9748366b24e2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_50682362b275b00d243686b24a17afef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_d6cbd89be5263a631d70082081d634b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_24a2c8e774d5166386390185fe4ffb1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_99de53606268ad09ea70820be115d336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9/5e7c6dd8-6b54-57a0-9fe6-73797e7ff8f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/32/82324a2c89666b2ee5644b2728612efa/pa/WA65207_dc97ea96f2a2de241aa3263f969eff30.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Intensive',
 'transmission': 'manual',
 'trim': 'Intensive',
 'year': 2014}
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA65207%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Saving data for WA65207: {'created_time': 1774696023.298871, 'last_price_update_time': 1774696023.298881, 'auction_closing_time': 1774883875.0}
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA65207') HTTP/1.1" 204 0
2026-03-28 11:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f97f5933690>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbc%252F56bc83a5562b2710d7b665bb41afde28%252Fpa%252FEM88527_200d5de2b6acef7210f992033c7e2bad.jpg') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_200d5de2b6acef7210f992033c7e2bad.jpg saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f647084e-3229-5ebc-9151-af0876c693c9
2026-03-28 11:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f647084e-3229-5ebc-9151-af0876c693c9, skipping ID generation
2026-03-28 11:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f647084e-3229-5ebc-9151-af0876c693c9 with scrape type 1
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f647084e-3229-5ebc-9151-af0876c693c9 sending to next pipeline
2026-03-28 11:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f647084e-3229-5ebc-9151-af0876c693c9, identifier: EM88527
2026-03-28 11:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f647084e-3229-5ebc-9151-af0876c693c9 with identifier: EM88527
2026-03-28 11:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f647084e-3229-5ebc-9151-af0876c693c9 with identifier: EM88527
2026-03-28 11:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f647084e-3229-5ebc-9151-af0876c693c9 with identifier: EM88527 to the API
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_200d5de2b6acef7210f992033c7e2bad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:28:17Z',
 'fuel_type': 'petrol',
 'id': 'f647084e-3229-5ebc-9151-af0876c693c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM88527',
 'listing': 'auction',
 'location': 'ES, Cabrera de Mar',
 'make': 'BMW',
 'model': '1er',
 'odometer': 178326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_317a3f6b6f1c3f113d3d925519a85b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_6847f1327747cbed8da0590554dffe2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_dbba37ad05adf388027a0f4a9bd565a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_13b9f0e8b9e627e213acf1b80ab5de25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_200d5de2b6acef7210f992033c7e2bad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_3b9cbdd1fbbd95af3c5c5ff9b8fc7706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_62e1b18e0826a5bfa0fdbee2fb79c0f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_c4acd1e874a73953f1a6ee92c4d94c6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_79c34ce6806187e224509bafc2e199c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f647084e-3229-5ebc-9151-af0876c693c9/f647084e-3229-5ebc-9151-af0876c693c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bc/56bc83a5562b2710d7b665bb41afde28/pa/EM88527_8b87e3da740b9af3735a3f6b5f71f74d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM88527%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Saving data for EM88527: {'created_time': 1774696023.879091, 'last_price_update_time': 1774696023.879103, 'auction_closing_time': 1774884497.0}
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM88527') HTTP/1.1" 204 0
2026-03-28 11:07:03 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: JM60139
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM60139%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Scrape type for JM60139: 0
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: HA89182
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA89182%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Scrape type for HA89182: 0
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: CB84377
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: XW18745
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: ZS64271
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS64271%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Scrape type for ZS64271: 0
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: XF30199
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF30199%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Scrape type for XF30199: 0
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: FD66244
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66244%27 HTTP/1.1" 200 None
2026-03-28 11:07:03 [auto1.es] INFO: Scrape type for FD66244: 0
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: PX41006
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: EK90431
2026-03-28 11:07:03 [auto1.es] INFO: Found listing with ID: XH71672
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH71672%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for XH71672: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: GF68019
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: CV42772
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: KK76277
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: MJ67844
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ67844%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for MJ67844: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: YK01379
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: YC35747
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: VU50837
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: TF90504
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF90504%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for TF90504: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: SE93661
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: GH75768
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH75768%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for GH75768: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT45338%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for CT45338: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: ZZ88385
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ88385%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for ZZ88385: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: MJ28673
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: VL89620
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: XU17862
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: BF43819
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: KB84639
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB84639%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for KB84639: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: KK74689
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK74689%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for KK74689: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: HL23580
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ71320%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for FZ71320: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: JV15285
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: GJ99683
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: YZ57313
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ57313%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for YZ57313: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA25095%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for HA25095: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: LG37212
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: YK71465
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK71465%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [auto1.es] INFO: Scrape type for YK71465: 0
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: NJ00425
2026-03-28 11:07:04 [auto1.es] INFO: Found listing with ID: HZ04358
2026-03-28 11:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:05 [scrapy.extensions.logstats] INFO: Crawled 143 pages (at 70 pages/min), scraped 70 items (at 39 items/min)
2026-03-28 11:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-28 11:07:05 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: NR06015
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: NB92875
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB92875%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for NB92875: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: JR86606
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: XU82709
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU82709%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for XU82709: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: ME40836
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: PL46605
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: VY63133
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY63133%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for VY63133: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: LU70143
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU70143%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for LU70143: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: TR46498
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: AZ98699
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ98699%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for AZ98699: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: RE19681
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE19681%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for RE19681: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: CG55928
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC47971%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for DC47971: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ18199%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for ZZ18199: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW73612%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for LW73612: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: MT83706
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT83706%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for MT83706: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: FT39942
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: TL79249
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW09077%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for NW09077: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: XN80961
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN80961%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for XN80961: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU95944%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for PU95944: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD22709%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for BD22709: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: BK80752
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: JE80773
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: GW48537
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: KL24436
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: JP19432
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: XG96311
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG96311%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for XG96311: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: CS77743
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS77743%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for CS77743: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW68168%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for RW68168: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: KM60868
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM60868%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [auto1.es] INFO: Scrape type for KM60868: 0
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: NY08728
2026-03-28 11:07:05 [auto1.es] INFO: Found listing with ID: CH99472
2026-03-28 11:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:06 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: AS02547
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: FZ98481
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ98481%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for FZ98481: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK45669%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for YK45669: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: EM05471
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM05471%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for EM05471: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: PM27944
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA38669%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for NA38669: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: EJ11744
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: EE23918
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: LL51979
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL51979%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for LL51979: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: EW80297
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW80297%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for EW80297: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL07915%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for YL07915: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: DD22164
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: TV69131
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV69131%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for TV69131: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: AR64085
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: HS39015
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: VF83817
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF83817%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for VF83817: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: LS09862
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS09862%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for LS09862: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: WH92663
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: FL34452
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: DS30814
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: WB36611
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: RY26799
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY26799%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for RY26799: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: UB97521
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB97521%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for UB97521: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY65056%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for KY65056: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: SJ54538
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: BG90226
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG90226%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for BG90226: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: GZ75005
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: BN23460
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN23460%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for BN23460: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: NW38370
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW38370%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for NW38370: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV31208%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for AV31208: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: MR84623
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR84623%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for MR84623: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: BK60003
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: JP53710
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: LZ41727
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ41727%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for LZ41727: 0
2026-03-28 11:07:06 [auto1.es] INFO: Found listing with ID: ZK36200
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK36200%27 HTTP/1.1" 200 None
2026-03-28 11:07:06 [auto1.es] INFO: Scrape type for ZK36200: 0
2026-03-28 11:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:07 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:07 [auto1.es] INFO: Found listing with ID: LV38775
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV38775%27 HTTP/1.1" 200 None
2026-03-28 11:07:07 [auto1.es] INFO: Scrape type for LV38775: 0
2026-03-28 11:07:07 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37153%27 HTTP/1.1" 200 None
2026-03-28 11:07:07 [auto1.es] INFO: Scrape type for ZM37153: 0
2026-03-28 11:07:07 [auto1.es] INFO: Found listing with ID: DJ31563
2026-03-28 11:07:07 [auto1.es] INFO: Found listing with ID: KN17188
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN17188%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for KN17188: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: CD82527
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD82527%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for CD82527: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: EX33598
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN90156%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for MN90156: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN32638%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for FN32638: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: ZR72253
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR72253%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for ZR72253: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: AS98814
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS98814%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for AS98814: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: BK97783
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: KK12600
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK12600%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for KK12600: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG89903%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for JG89903: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: PK49923
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: LM83979
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM83979%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for LM83979: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: GK87335
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK87335%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for GK87335: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV65502%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for HV65502: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: EM52584
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL97970%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for JL97970: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM34932%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for ZM34932: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR33339%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for TR33339: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: WJ21268
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: HC75906
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: FW26627
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW26627%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for FW26627: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: WZ74914
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ74914%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for WZ74914: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: BY70112
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF76170%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for UF76170: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: GU11117
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU11117%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for GU11117: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE21936%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for XE21936: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: XS40822
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS40822%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for XS40822: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: AN90905
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN90905%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for AN90905: 0
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: AF12628
2026-03-28 11:07:08 [auto1.es] INFO: Found listing with ID: RE01246
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE01246%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [auto1.es] INFO: Scrape type for RE01246: 2
2026-03-28 11:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335c91d3-8914-5ddc-af57-0a4612a84e73 with identifier: RE01246
2026-03-28 11:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335c91d3-8914-5ddc-af57-0a4612a84e73 with scrape type 2
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 335c91d3-8914-5ddc-af57-0a4612a84e73 with scrape type 2
2026-03-28 11:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 335c91d3-8914-5ddc-af57-0a4612a84e73, identifier: RE01246
2026-03-28 11:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 335c91d3-8914-5ddc-af57-0a4612a84e73 with identifier: RE01246
2026-03-28 11:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 335c91d3-8914-5ddc-af57-0a4612a84e73 with identifier: RE01246
2026-03-28 11:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 335c91d3-8914-5ddc-af57-0a4612a84e73 with identifier: RE01246 to the API
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:06:25Z',
 'fuel_type': 'petrol',
 'id': '335c91d3-8914-5ddc-af57-0a4612a84e73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE01246',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 258786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2016}
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE01246%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [auto1.es] INFO: Saving data for RE01246: {'auction_closing_time': 1774713985.0, 'created_time': 1773180547.166313, 'last_price_update_time': 1774696029.044816}
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RE01246') HTTP/1.1" 204 0
2026-03-28 11:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:09 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP11103%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [auto1.es] INFO: Scrape type for SP11103: 0
2026-03-28 11:07:09 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME86804%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [auto1.es] INFO: Scrape type for ME86804: 0
2026-03-28 11:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:10 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC91216%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for WC91216: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: DL38940
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: EE29510
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE29510%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for EE29510: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: ED08036
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: SZ63462
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU33051%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for RU33051: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: VL31670
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: LL79483
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL79483%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for LL79483: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: UX89995
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX89995%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for UX89995: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: KB87901
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: WB10025
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB10025%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for WB10025: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: AK86639
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK86639%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for AK86639: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: MB13391
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU77194%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for YU77194: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU71868%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for TU71868: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT49013%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for XT49013: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: KD45513
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD45513%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for KD45513: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: YD06518
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: UT62475
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT62475%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for UT62475: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: VJ40184
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ40184%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for VJ40184: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF82701%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for VF82701: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: PE23246
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: DR94392
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: HC55702
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC55702%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for HC55702: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: SR16333
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR16333%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for SR16333: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: XL86918
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL86918%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for XL86918: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: YB76254
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: LH51054
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ65854%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for TZ65854: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: XJ12820
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for XJ12820: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: XZ41303
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ41303%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for XZ41303: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: MG78931
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG78931%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for MG78931: 0
2026-03-28 11:07:10 [auto1.es] INFO: Found listing with ID: HW09758
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW09758%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [auto1.es] INFO: Scrape type for HW09758: 0
2026-03-28 11:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:11 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: AU55314
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU55314%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for AU55314: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: LF34869
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF34869%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for LF34869: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: CX01476
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: YW16377
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW16377%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for YW16377: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: LK93242
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK93242%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for LK93242: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: BP77567
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: HR03779
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH48089%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for XH48089: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: AM70674
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: WY37005
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY37005%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for WY37005: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD82310%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for YD82310: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY28028%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for JY28028: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: KP85187
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: LM23612
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ79467%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for ZJ79467: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: YB91209
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: VM24550
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM24550%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for VM24550: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY16835%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for YY16835: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: PC46178
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: FN37558
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN37558%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for FN37558: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB28446%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for DB28446: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53937%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for KS53937: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: FX87163
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX87163%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [auto1.es] INFO: Scrape type for FX87163: 0
2026-03-28 11:07:11 [auto1.es] INFO: Found listing with ID: UK11838
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK11838%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for UK11838: 0
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW63422%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for NW63422: 0
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: BP61591
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for BP61591: 0
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS69638%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for LS69638: 0
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: WF15705
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF15705%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for WF15705: 0
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: NJ68356
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: NP49445
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP49445%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for NP49445: 0
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: FR82793
2026-03-28 11:07:12 [auto1.es] INFO: Found listing with ID: HJ26610
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ26610%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [auto1.es] INFO: Scrape type for HJ26610: 0
2026-03-28 11:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:43 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2559 | hits on page: 40
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF82591%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for LF82591: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW63971%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for HW63971: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: GU42237
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH35807%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for RH35807: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: HN32774
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN32774%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for HN32774: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: YS28184
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS28184%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for YS28184: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: VR49277
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR49277%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for VR49277: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ90358%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for FJ90358: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: TU72594
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU72594%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for TU72594: 0
2026-03-28 11:07:43 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR48575%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Scrape type for CR48575: 2
2026-03-28 11:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5257aab-bf54-5a72-a362-f5eb1d0c7635 with identifier: CR48575
2026-03-28 11:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5257aab-bf54-5a72-a362-f5eb1d0c7635 with scrape type 2
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5257aab-bf54-5a72-a362-f5eb1d0c7635 with scrape type 2
2026-03-28 11:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5257aab-bf54-5a72-a362-f5eb1d0c7635, identifier: CR48575
2026-03-28 11:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5257aab-bf54-5a72-a362-f5eb1d0c7635 with identifier: CR48575
2026-03-28 11:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5257aab-bf54-5a72-a362-f5eb1d0c7635 with identifier: CR48575
2026-03-28 11:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5257aab-bf54-5a72-a362-f5eb1d0c7635 with identifier: CR48575 to the API
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:35Z',
 'fuel_type': 'petrol',
 'id': 'f5257aab-bf54-5a72-a362-f5eb1d0c7635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR48575',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 167607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Ford Fiesta 2.0 ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2008}
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR48575%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [auto1.es] INFO: Saving data for CR48575: {'auction_closing_time': 1774714175.0, 'created_time': 1774512322.735876, 'last_price_update_time': 1774696063.969167}
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CR48575') HTTP/1.1" 204 0
2026-03-28 11:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: WR24367
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR24367%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for WR24367: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL94048%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for VL94048: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: TW02627
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: AE32204
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE32204%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for AE32204: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: PF77952
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF77952%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for PF77952: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: HR81146
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: YD06754
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD06754%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for YD06754: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: WD69770
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD69770%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for WD69770: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK62452%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for LK62452: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: PG01286
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: YT35531
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT35531%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for YT35531: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR00464%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for UR00464: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV47930%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for WV47930: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM90018%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for DM90018: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM47601%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for WM47601: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: TD48491
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD48491%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for TD48491: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC13262%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for FC13262: 0
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-28 11:07:44 [auto1.es] INFO: Found listing with ID: SM64355
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM64355%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [auto1.es] INFO: Scrape type for SM64355: 0
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:45 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: SM64355
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM64355%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for SM64355: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: NU52184
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NU52184%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for NU52184: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: FY50963
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: AZ28710
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC59600%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for TC59600: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: VP39561
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: EU66649
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU66649%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for EU66649: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY66249%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for FY66249: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR87201%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for PR87201: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: FK50092
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: ZJ44850
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ44850%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for ZJ44850: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: PZ33789
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ33789%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for PZ33789: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: LP06915
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: GD92135
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE71239%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for ZE71239: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: AC50024
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: JK92446
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP55531%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for UP55531: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: WD98300
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD98300%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for WD98300: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: MF04433
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF04433%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for MF04433: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: VV66247
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: BK72591
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: NV84448
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: TB24356
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: WG98827
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: GA27189
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA27189%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for GA27189: 0
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: WJ72825
2026-03-28 11:07:45 [auto1.es] INFO: Found listing with ID: YN66456
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN66456%27 HTTP/1.1" 200 None
2026-03-28 11:07:45 [auto1.es] INFO: Scrape type for YN66456: 0
2026-03-28 11:07:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:46 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT89838%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for UT89838: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: WL78686
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL78686%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for WL78686: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU11449%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for GU11449: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG38450%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for DG38450: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: MR72452
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: KF98963
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: EK65360
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC72839%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for WC72839: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: ZK05634
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM00276%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for LM00276: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64708%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for AP64708: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: SE84848
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE84848%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for SE84848: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW07393%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for KW07393: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: EH84467
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH84467%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for EH84467: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: ZW00345
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: SZ42428
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ42428%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for SZ42428: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH24419%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for WH24419: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: EH99000
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH99000%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for EH99000: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX85730%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for FX85730: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN34966%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for TN34966: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: NA23399
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: YG50456
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG50456%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for YG50456: 0
2026-03-28 11:07:46 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU21075%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [auto1.es] INFO: Scrape type for TU21075: 2
2026-03-28 11:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb88e2b-8b68-56f7-8fbb-35a3b2b914a1 with identifier: TU21075
2026-03-28 11:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb88e2b-8b68-56f7-8fbb-35a3b2b914a1 with scrape type 2
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afb88e2b-8b68-56f7-8fbb-35a3b2b914a1 with scrape type 2
2026-03-28 11:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: afb88e2b-8b68-56f7-8fbb-35a3b2b914a1, identifier: TU21075
2026-03-28 11:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: afb88e2b-8b68-56f7-8fbb-35a3b2b914a1 with identifier: TU21075
2026-03-28 11:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: afb88e2b-8b68-56f7-8fbb-35a3b2b914a1 with identifier: TU21075
2026-03-28 11:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: afb88e2b-8b68-56f7-8fbb-35a3b2b914a1 with identifier: TU21075 to the API
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:45Z',
 'fuel_type': 'diesel',
 'id': 'afb88e2b-8b68-56f7-8fbb-35a3b2b914a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU21075',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 170430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-15',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2015}
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU21075%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [auto1.es] INFO: Saving data for TU21075: {'auction_closing_time': 1774714845.0, 'created_time': 1774512320.26943, 'last_price_update_time': 1774696067.407966}
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU21075') HTTP/1.1" 204 0
2026-03-28 11:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: AV16131
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV16131%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [auto1.es] INFO: Scrape type for AV16131: 0
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: XJ28313
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ28313%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [auto1.es] INFO: Scrape type for XJ28313: 0
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: FJ85779
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ85779%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [auto1.es] INFO: Scrape type for FJ85779: 0
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: MJ22041
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV18028%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [auto1.es] INFO: Scrape type for BV18028: 0
2026-03-28 11:07:47 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:48 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: SN53081
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN53081%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for SN53081: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: RC21123
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC21123%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for RC21123: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: ZX16676
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: FZ38414
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH19294%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for LH19294: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: XE96184
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE96184%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for XE96184: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: GY33906
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY33906%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for GY33906: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: HY73546
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY73546%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for HY73546: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK12831%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for MK12831: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS59204%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for WS59204: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: PT59425
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT59425%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for PT59425: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: YG37812
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG37812%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for YG37812: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ49539%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for PJ49539: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: RJ04030
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: GS46060
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: JJ86148
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ86148%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [auto1.es] INFO: Scrape type for JJ86148: 0
2026-03-28 11:07:48 [auto1.es] INFO: Found listing with ID: HW81498
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW81498%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for HW81498: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: JX49148
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX49148%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for JX49148: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: AF00025
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM59518%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for NM59518: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU32370%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for TU32370: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: RS43039
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: FF66391
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: TU27127
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: TU02735
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU02735%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for TU02735: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT63961%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for KT63961: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG64326%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for KG64326: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV75018%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for WV75018: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: TX48554
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX48554%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for TX48554: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: DW56939
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW56939%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for DW56939: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: WA73685
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73685%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for WA73685: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: AG21540
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG21540%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for AG21540: 0
2026-03-28 11:07:49 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE29588%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [auto1.es] INFO: Scrape type for RE29588: 0
2026-03-28 11:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:50 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: KG74250
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG74250%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for KG74250: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV71103%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for XV71103: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: ZG15911
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: ZL22233
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: WL57224
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: SA46382
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS16028%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for HS16028: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: AK39798
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK39798%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for AK39798: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: ER64575
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD85443%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for PD85443: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: FR28511
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR28511%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for FR28511: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: CK41460
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK41460%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for CK41460: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC07750%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for BC07750: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: YR87797
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR87797%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for YR87797: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: US86710
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS83743%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for AS83743: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML55356%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for ML55356: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: WY05538
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY05538%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for WY05538: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF26714%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for FF26714: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: KY38332
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY38332%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for KY38332: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: MN54657
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN54657%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for MN54657: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: MV29713
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV29713%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for MV29713: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL07647%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for FL07647: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB50501%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for XB50501: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: RM85615
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: WF53807
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: US15459
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: NX73421
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX73421%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for NX73421: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY12745%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for YY12745: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD17478%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for LD17478: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: FH07549
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH07549%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for FH07549: 0
2026-03-28 11:07:50 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF82044%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [auto1.es] INFO: Scrape type for PF82044: 0
2026-03-28 11:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:51 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: BY63311
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY63311%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for BY63311: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY33639%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for CY33639: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: LH99658
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH99658%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for LH99658: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD45625%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for PD45625: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD38057%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for GD38057: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: RK74623
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK74623%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for RK74623: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: PT78708
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT78708%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for PT78708: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: SP90051
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP90051%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for SP90051: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT52456%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for ZT52456: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: YP26589
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP26589%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for YP26589: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: LD07198
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: RD88147
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD88147%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for RD88147: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF50225%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for NF50225: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: HK38908
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL26730%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for DL26730: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: JB62304
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB62304%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for JB62304: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: SP20451
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP20451%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for SP20451: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: YE50848
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE50848%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for YE50848: 0
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: VG19882
2026-03-28 11:07:51 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK51395%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [auto1.es] INFO: Scrape type for YK51395: 2
2026-03-28 11:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1728ef2-55e8-500f-8189-91777a1d091e with identifier: YK51395
2026-03-28 11:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1728ef2-55e8-500f-8189-91777a1d091e with scrape type 2
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1728ef2-55e8-500f-8189-91777a1d091e with scrape type 2
2026-03-28 11:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1728ef2-55e8-500f-8189-91777a1d091e, identifier: YK51395
2026-03-28 11:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1728ef2-55e8-500f-8189-91777a1d091e with identifier: YK51395
2026-03-28 11:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1728ef2-55e8-500f-8189-91777a1d091e with identifier: YK51395
2026-03-28 11:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1728ef2-55e8-500f-8189-91777a1d091e with identifier: YK51395 to the API
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:10:10Z',
 'fuel_type': 'petrol',
 'id': 'c1728ef2-55e8-500f-8189-91777a1d091e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK51395',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 211838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-06',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Sol',
 'transmission': 'manual',
 'trim': 'Compact Sol',
 'year': 2003}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK51395%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Saving data for YK51395: {'auction_closing_time': 1774714210.0, 'created_time': 1774512328.202311, 'last_price_update_time': 1774696072.450819}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK51395') HTTP/1.1" 204 0
2026-03-28 11:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG66489%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for AG66489: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: HY26691
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY26691%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for HY26691: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: BX65620
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT23405%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for HT23405: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: ST42885
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST42885%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for ST42885: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF99536%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for GF99536: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: UJ65320
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: WW31091
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW31091%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for WW31091: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: PT77544
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT77544%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for PT77544: 0
2026-03-28 11:07:52 [auto1.es] INFO: Found listing with ID: YG72070
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG72070%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [auto1.es] INFO: Scrape type for YG72070: 0
2026-03-28 11:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:53 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX60688%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for BX60688: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB96855%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for EB96855: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ69303%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for XJ69303: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: UY47592
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH46764%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for HH46764: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB94347%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for YB94347: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: NZ09379
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY25635%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for XY25635: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: MN96118
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: SL72652
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: JP30275
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP30275%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for JP30275: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: JX80621
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF77258%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for SF77258: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR92407%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for XR92407: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT36194%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for NT36194: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: PC22199
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC22199%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for PC22199: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: AG75766
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: XY83185
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: MW26851
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW26851%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for MW26851: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ29136%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for BZ29136: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: BU72892
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU72892%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for BU72892: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: JX17367
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX17367%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for JX17367: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: KM36431
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM36431%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for KM36431: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: WC35260
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF10967%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for ZF10967: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK64156%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [auto1.es] INFO: Scrape type for JK64156: 0
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: RW45199
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: BA78017
2026-03-28 11:07:53 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-28 11:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:54 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:54 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-28 11:07:54 [auto1.es] INFO: Found listing with ID: NL01564
2026-03-28 11:07:54 [auto1.es] INFO: Found listing with ID: GG08550
2026-03-28 11:07:54 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61689%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for VJ61689: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: MG47386
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: BF82327
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: MH30055
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH30055%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for MH30055: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: KS98335
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL06778%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for YL06778: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK01159%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for SK01159: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: PZ99435
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ99435%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for PZ99435: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: AA63946
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA63946%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for AA63946: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: LL40861
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: YL34665
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL34665%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for YL34665: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: VJ44998
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: XX41183
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX41183%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for XX41183: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: YH27551
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH27551%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for YH27551: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR55958%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for RR55958: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD17011%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for PD17011: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: GG28459
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: HK75942
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ94183%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for CZ94183: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: ZA55994
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA55994%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for ZA55994: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC51622%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for PC51622: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: SN64789
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN64789%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for SN64789: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: HK12855
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK12855%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for HK12855: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: EN87990
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN87990%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for EN87990: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: XH57732
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK39366%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for AK39366: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: KH58468
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG44284%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [auto1.es] INFO: Scrape type for MG44284: 0
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: SL52436
2026-03-28 11:07:55 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-28 11:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:56 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:56 [auto1.es] INFO: Found listing with ID: KA53373
2026-03-28 11:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA53373%27 HTTP/1.1" 200 None
2026-03-28 11:07:56 [auto1.es] INFO: Scrape type for KA53373: 0
2026-03-28 11:07:56 [auto1.es] INFO: Found listing with ID: PF81025
2026-03-28 11:07:56 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-28 11:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP63371%27 HTTP/1.1" 200 None
2026-03-28 11:07:56 [auto1.es] INFO: Scrape type for ZP63371: 2
2026-03-28 11:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de0a141-bec6-5f27-be6a-a3aeca3958ac with identifier: ZP63371
2026-03-28 11:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de0a141-bec6-5f27-be6a-a3aeca3958ac with scrape type 2
2026-03-28 11:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de0a141-bec6-5f27-be6a-a3aeca3958ac with scrape type 2
2026-03-28 11:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1de0a141-bec6-5f27-be6a-a3aeca3958ac, identifier: ZP63371
2026-03-28 11:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1de0a141-bec6-5f27-be6a-a3aeca3958ac with identifier: ZP63371
2026-03-28 11:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1de0a141-bec6-5f27-be6a-a3aeca3958ac with identifier: ZP63371
2026-03-28 11:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1de0a141-bec6-5f27-be6a-a3aeca3958ac with identifier: ZP63371 to the API
2026-03-28 11:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:46Z',
 'fuel_type': 'diesel',
 'id': '1de0a141-bec6-5f27-be6a-a3aeca3958ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP63371',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 252236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-19',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2018}
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP63371%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Saving data for ZP63371: {'auction_closing_time': 1774716766.0, 'created_time': 1774512326.375143, 'last_price_update_time': 1774696077.352186}
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZP63371') HTTP/1.1" 204 0
2026-03-28 11:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF13100%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for YF13100: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: YR71719
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for YR71719: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: YW89108
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: DW38851
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW38851%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for DW38851: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: GU69943
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: YU31002
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: NA15103
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA15103%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for NA15103: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC77404%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for LC77404: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: NC39762
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC39762%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for NC39762: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: EV89991
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: YZ29146
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: UD79775
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17075%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for LJ17075: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: CN46922
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN46922%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for CN46922: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: PU35155
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU35155%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for PU35155: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT40833%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for GT40833: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: XZ52900
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ52900%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for XZ52900: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: US62841
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: NF79265
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: WT21682
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: CN05073
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP11478%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for VP11478: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG29597%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for VG29597: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: PK17062
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: YX85928
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW07247%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for JW07247: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: RE64316
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE64316%27 HTTP/1.1" 200 None
2026-03-28 11:07:57 [auto1.es] INFO: Scrape type for RE64316: 0
2026-03-28 11:07:57 [auto1.es] INFO: Found listing with ID: RA16154
2026-03-28 11:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:58 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH68644%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for YH68644: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA88394%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for WA88394: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: PH91048
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: FH27641
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH27641%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for FH27641: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: EV12094
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV12094%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for EV12094: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH38483%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for CH38483: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: KJ28856
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ28856%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for KJ28856: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: FE33802
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: JC17966
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC17966%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for JC17966: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: XZ06121
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: KG68296
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: AJ93581
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: UR41471
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: CN83416
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: DE85844
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: KX46751
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: VV79755
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: BV16371
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL52368%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for WL52368: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: SJ53715
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: RC81564
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ81343%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for RJ81343: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK68537%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for LK68537: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU28227%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for VU28227: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA80784%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for ZA80784: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: PN97483
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: YZ97545
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: BY18698
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY18698%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for BY18698: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: DR12042
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: EG74552
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: MJ33537
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ33537%27 HTTP/1.1" 200 None
2026-03-28 11:07:58 [auto1.es] INFO: Scrape type for MJ33537: 0
2026-03-28 11:07:58 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-28 11:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:07:59 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2560 | hits on page: 40
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ75824%27 HTTP/1.1" 200 None
2026-03-28 11:07:59 [auto1.es] INFO: Scrape type for HJ75824: 0
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: DJ31574
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: MX73277
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX73277%27 HTTP/1.1" 200 None
2026-03-28 11:07:59 [auto1.es] INFO: Scrape type for MX73277: 0
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: HC34911
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: RV14392
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV14392%27 HTTP/1.1" 200 None
2026-03-28 11:07:59 [auto1.es] INFO: Scrape type for RV14392: 0
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: SY91056
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH89256%27 HTTP/1.1" 200 None
2026-03-28 11:07:59 [auto1.es] INFO: Scrape type for DH89256: 0
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: PU00730
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: GJ83927
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ83927%27 HTTP/1.1" 200 None
2026-03-28 11:07:59 [auto1.es] INFO: Scrape type for GJ83927: 0
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: PK46399
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK46399%27 HTTP/1.1" 200 None
2026-03-28 11:07:59 [auto1.es] INFO: Scrape type for PK46399: 0
2026-03-28 11:07:59 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ41335%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for CZ41335: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: XJ15260
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: TL40717
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: SG19170
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG19170%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for SG19170: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: JB47197
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB47197%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for JB47197: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS97770%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for LS97770: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: ME02001
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME02001%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for ME02001: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: YC67931
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: TM54521
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM54521%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for TM54521: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE32180%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for NE32180: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: EW19678
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW19678%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for EW19678: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: CJ74975
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ74975%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for CJ74975: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW02489%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for CW02489: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: UX78126
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: VV06777
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV06777%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for VV06777: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: ZM36181
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM36181%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for ZM36181: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ25414%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for NJ25414: 2
2026-03-28 11:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f0479a2-3d42-5cd4-9062-81e1ac83de52 with identifier: NJ25414
2026-03-28 11:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f0479a2-3d42-5cd4-9062-81e1ac83de52 with scrape type 2
2026-03-28 11:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f0479a2-3d42-5cd4-9062-81e1ac83de52 with scrape type 2
2026-03-28 11:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f0479a2-3d42-5cd4-9062-81e1ac83de52, identifier: NJ25414
2026-03-28 11:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f0479a2-3d42-5cd4-9062-81e1ac83de52 with identifier: NJ25414
2026-03-28 11:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f0479a2-3d42-5cd4-9062-81e1ac83de52 with identifier: NJ25414
2026-03-28 11:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f0479a2-3d42-5cd4-9062-81e1ac83de52 with identifier: NJ25414 to the API
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:54:14Z',
 'fuel_type': 'hybrid',
 'id': '8f0479a2-3d42-5cd4-9062-81e1ac83de52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ25414',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 70614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-09',
 'seller_name': None,
 'title': 'Toyota C-HR 2.0 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ25414%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Saving data for NJ25414: {'auction_closing_time': 1774716854.0, 'created_time': 1774512352.521241, 'last_price_update_time': 1774696080.737966}
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ25414') HTTP/1.1" 204 0
2026-03-28 11:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: ES00256
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: WG83508
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG83508%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for WG83508: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: JG83987
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG83987%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for JG83987: 0
2026-03-28 11:08:00 [auto1.es] INFO: Found listing with ID: LE44410
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE44410%27 HTTP/1.1" 200 None
2026-03-28 11:08:00 [auto1.es] INFO: Scrape type for LE44410: 0
2026-03-28 11:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:01 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:01 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-28 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC68158%27 HTTP/1.1" 200 None
2026-03-28 11:08:01 [auto1.es] INFO: Scrape type for VC68158: 2
2026-03-28 11:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158
2026-03-28 11:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc81e69-f6a8-5895-aa39-13828b38365d with scrape type 2
2026-03-28 11:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afc81e69-f6a8-5895-aa39-13828b38365d with scrape type 2
2026-03-28 11:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: afc81e69-f6a8-5895-aa39-13828b38365d, identifier: VC68158
2026-03-28 11:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158
2026-03-28 11:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158
2026-03-28 11:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158 to the API
2026-03-28 11:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:13:25Z',
 'fuel_type': 'diesel',
 'id': 'afc81e69-f6a8-5895-aa39-13828b38365d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC68158',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Exeo',
 'odometer': 244476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-07',
 'seller_name': None,
 'title': 'Seat Exeo 2.0 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC68158%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Saving data for VC68158: {'auction_closing_time': 1774714405.0, 'created_time': 1774512323.668728, 'last_price_update_time': 1774696082.139919}
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC68158') HTTP/1.1" 204 0
2026-03-28 11:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW30264%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for WW30264: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK17439%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for SK17439: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: FC08911
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: TJ87450
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: ET27583
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET27583%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for ET27583: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: RF10879
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: SR01470
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR01470%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for SR01470: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: JC88561
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC88561%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for JC88561: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL51279%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for DL51279: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: UC09258
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC09258%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for UC09258: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: HK88265
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: CX27112
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG13081%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for DG13081: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: YH51861
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: YD66722
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: YU72281
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: TW45528
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: CD57804
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ44252%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for GZ44252: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT90695%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for RT90695: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC37690%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for BC37690: 2
2026-03-28 11:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f6b287a-3ec5-519c-9005-66dca8874ce5 with identifier: BC37690
2026-03-28 11:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f6b287a-3ec5-519c-9005-66dca8874ce5 with scrape type 2
2026-03-28 11:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f6b287a-3ec5-519c-9005-66dca8874ce5 with scrape type 2
2026-03-28 11:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f6b287a-3ec5-519c-9005-66dca8874ce5, identifier: BC37690
2026-03-28 11:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f6b287a-3ec5-519c-9005-66dca8874ce5 with identifier: BC37690
2026-03-28 11:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f6b287a-3ec5-519c-9005-66dca8874ce5 with identifier: BC37690
2026-03-28 11:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f6b287a-3ec5-519c-9005-66dca8874ce5 with identifier: BC37690 to the API
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:21Z',
 'fuel_type': 'diesel',
 'id': '1f6b287a-3ec5-519c-9005-66dca8874ce5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC37690',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 179272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-29',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC37690%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Saving data for BC37690: {'auction_closing_time': 1774715841.0, 'created_time': 1773951535.144396, 'last_price_update_time': 1774696082.737752}
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BC37690') HTTP/1.1" 204 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: AD89683
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD89683%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for AD89683: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: TH72342
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH72342%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for TH72342: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW16894%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for GW16894: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA62942%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for TA62942: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: WK84423
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: NL09405
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: DG34195
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: YF57320
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF57320%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for YF57320: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: DP90373
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP90373%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for DP90373: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: CY07348
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY07348%27 HTTP/1.1" 200 None
2026-03-28 11:08:02 [auto1.es] INFO: Scrape type for CY07348: 0
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-28 11:08:02 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-28 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF55946%27 HTTP/1.1" 200 None
2026-03-28 11:08:03 [auto1.es] INFO: Scrape type for BF55946: 0
2026-03-28 11:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:04 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05044%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for SN05044: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD75300%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for PD75300: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR01411%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for VR01411: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: GA11784
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA11784%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for GA11784: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN31464%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for XN31464: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG74382%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for AG74382: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: KD95768
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD95768%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for KD95768: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: EY10319
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: KN38404
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN38404%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for KN38404: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: MY11525
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY11525%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for MY11525: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: WC31368
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC31368%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for WC31368: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: YC45232
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN76428%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for RN76428: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: VZ27900
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ27900%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for VZ27900: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM02811%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for VM02811: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: SA97364
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN48469%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for UN48469: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: NA86164
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA86164%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for NA86164: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: SW69088
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: BW81200
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW81200%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for BW81200: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: AR07470
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: FD93505
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD93505%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for FD93505: 0
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-28 11:08:04 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW99692%27 HTTP/1.1" 200 None
2026-03-28 11:08:04 [auto1.es] INFO: Scrape type for PW99692: 2
2026-03-28 11:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5230dac2-72e1-5b20-b020-f7719fcf174c with identifier: PW99692
2026-03-28 11:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5230dac2-72e1-5b20-b020-f7719fcf174c with scrape type 2
2026-03-28 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5230dac2-72e1-5b20-b020-f7719fcf174c with scrape type 2
2026-03-28 11:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5230dac2-72e1-5b20-b020-f7719fcf174c, identifier: PW99692
2026-03-28 11:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5230dac2-72e1-5b20-b020-f7719fcf174c with identifier: PW99692
2026-03-28 11:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5230dac2-72e1-5b20-b020-f7719fcf174c with identifier: PW99692
2026-03-28 11:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5230dac2-72e1-5b20-b020-f7719fcf174c with identifier: PW99692 to the API
2026-03-28 11:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:48:00Z',
 'fuel_type': 'diesel',
 'id': '5230dac2-72e1-5b20-b020-f7719fcf174c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW99692',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 189637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-14',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW99692%27 HTTP/1.1" 200 None
2026-03-28 11:08:05 [auto1.es] INFO: Saving data for PW99692: {'auction_closing_time': 1774716480.0, 'created_time': 1774512323.983362, 'last_price_update_time': 1774696085.108783}
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PW99692') HTTP/1.1" 204 0
2026-03-28 11:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY79156%27 HTTP/1.1" 200 None
2026-03-28 11:08:05 [auto1.es] INFO: Scrape type for VY79156: 0
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL69555%27 HTTP/1.1" 200 None
2026-03-28 11:08:05 [auto1.es] INFO: Scrape type for ZL69555: 0
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: JC19208
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC19208%27 HTTP/1.1" 200 None
2026-03-28 11:08:05 [auto1.es] INFO: Scrape type for JC19208: 0
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VS82741%27 HTTP/1.1" 200 None
2026-03-28 11:08:05 [auto1.es] INFO: Scrape type for VS82741: 0
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: CH02568
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH02568%27 HTTP/1.1" 200 None
2026-03-28 11:08:05 [auto1.es] INFO: Scrape type for CH02568: 0
2026-03-28 11:08:05 [auto1.es] INFO: Found listing with ID: YA31535
2026-03-28 11:08:05 [scrapy.extensions.logstats] INFO: Crawled 160 pages (at 17 pages/min), scraped 79 items (at 9 items/min)
2026-03-28 11:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-28 11:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:06 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: RW57284
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW57284%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for RW57284: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ10048%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for MJ10048: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: TF35206
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF35206%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for TF35206: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: YL41788
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: KY27191
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY27191%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for KY27191: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: GY66563
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: WC51146
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: EX52175
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17939%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for KL17939: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG24338%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for YG24338: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: NB11190
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH47587%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for FH47587: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: FS24848
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS24848%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for FS24848: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: JB29857
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: VE17467
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE17467%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for VE17467: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: ZB98870
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB98870%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for ZB98870: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: RR37131
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR37131%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for RR37131: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: TX53008
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX53008%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for TX53008: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: KX23330
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX23330%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for KX23330: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: UG82758
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY39157%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for GY39157: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: TV93426
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV93426%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for TV93426: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: VH23688
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU93951%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for MU93951: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: VU67275
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU67275%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for VU67275: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: VL75431
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: PB35716
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC06824%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for WC06824: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: HV93146
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR52566%27 HTTP/1.1" 200 None
2026-03-28 11:08:06 [auto1.es] INFO: Scrape type for NR52566: 0
2026-03-28 11:08:06 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-28 11:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:10 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD60260%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for TD60260: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: XA12312
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA12312%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for XA12312: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: FT73766
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM72054%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for YM72054: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: UX12381
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX12381%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for UX12381: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: PP93305
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: BK24148
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: YA45169
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE24734%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for AE24734: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: AC91156
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: FH72535
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH72535%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for FH72535: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: BH69278
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: CR04544
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: DS93846
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS93846%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for DS93846: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: KL41152
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: YE09930
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB61397%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for XB61397: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: CV87260
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV87260%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for CV87260: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW73484%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for ZW73484: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: TY35729
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: BV26369
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV26369%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.es] INFO: Scrape type for BV26369: 0
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-28 11:08:10 [auto1.es] INFO: Found listing with ID: SC59966
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC59966%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.es] INFO: Scrape type for SC59966: 0
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF44253%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.es] INFO: Scrape type for EF44253: 0
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD15291%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.es] INFO: Scrape type for XD15291: 0
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: NT29011
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: ZR33369
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: WC19502
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC19502%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.es] INFO: Scrape type for WC19502: 0
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08407%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.es] INFO: Scrape type for UP08407: 0
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: TD30983
2026-03-28 11:08:11 [auto1.es] INFO: Found listing with ID: SH43107
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH43107%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.es] INFO: Scrape type for SH43107: 0
2026-03-28 11:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:12 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV39877%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for KV39877: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: TT78731
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT78731%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for TT78731: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: CD98275
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC35826%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for DC35826: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: JN26439
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN26439%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for JN26439: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21780%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for YS21780: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG05674%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for BG05674: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: DH23772
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: HH68332
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: ME41297
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME41297%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for ME41297: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: BW06558
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: NV73082
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV73082%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for NV73082: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA08789%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for MA08789: 2
2026-03-28 11:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a889c2f-cbc5-5741-ba7b-62899b825436 with identifier: MA08789
2026-03-28 11:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a889c2f-cbc5-5741-ba7b-62899b825436 with scrape type 2
2026-03-28 11:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a889c2f-cbc5-5741-ba7b-62899b825436 with scrape type 2
2026-03-28 11:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a889c2f-cbc5-5741-ba7b-62899b825436, identifier: MA08789
2026-03-28 11:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a889c2f-cbc5-5741-ba7b-62899b825436 with identifier: MA08789
2026-03-28 11:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a889c2f-cbc5-5741-ba7b-62899b825436 with identifier: MA08789
2026-03-28 11:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a889c2f-cbc5-5741-ba7b-62899b825436 with identifier: MA08789 to the API
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:39:43Z',
 'fuel_type': 'diesel',
 'id': '1a889c2f-cbc5-5741-ba7b-62899b825436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA08789',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 123127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2019}
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA08789%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Saving data for MA08789: {'auction_closing_time': 1774715983.0, 'created_time': 1774512324.489071, 'last_price_update_time': 1774696092.789197}
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA08789') HTTP/1.1" 204 0
2026-03-28 11:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: VC32257
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC32257%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for VC32257: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH30785%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for XH30785: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: RL96289
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: WB94881
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB94881%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for WB94881: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: BS00293
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: MR84448
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR84448%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for MR84448: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: FA94127
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA94127%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.es] INFO: Scrape type for FA94127: 0
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: YP93952
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: FB20792
2026-03-28 11:08:12 [auto1.es] INFO: Found listing with ID: HZ26587
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ26587%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for HZ26587: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH85625%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for RH85625: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: DG40190
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: MP04292
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP04292%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for MP04292: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: YW02554
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW02554%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for YW02554: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY33726%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for WY33726: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR59073%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for AR59073: 2
2026-03-28 11:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f7ff83-2d30-599c-a311-c686efceef52 with identifier: AR59073
2026-03-28 11:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f7ff83-2d30-599c-a311-c686efceef52 with scrape type 2
2026-03-28 11:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f7ff83-2d30-599c-a311-c686efceef52 with scrape type 2
2026-03-28 11:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0f7ff83-2d30-599c-a311-c686efceef52, identifier: AR59073
2026-03-28 11:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0f7ff83-2d30-599c-a311-c686efceef52 with identifier: AR59073
2026-03-28 11:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0f7ff83-2d30-599c-a311-c686efceef52 with identifier: AR59073
2026-03-28 11:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a0f7ff83-2d30-599c-a311-c686efceef52 with identifier: AR59073 to the API
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:12:30Z',
 'fuel_type': 'petrol',
 'id': 'a0f7ff83-2d30-599c-a311-c686efceef52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR59073',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 168904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-01',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR59073%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Saving data for AR59073: {'auction_closing_time': 1774714350.0, 'created_time': 1773952053.262317, 'last_price_update_time': 1774696093.493341}
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AR59073') HTTP/1.1" 204 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: NH73319
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: MV76420
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV76420%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for MV76420: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: TZ42213
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA84687%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.es] INFO: Scrape type for MA84687: 0
2026-03-28 11:08:13 [auto1.es] INFO: Found listing with ID: TY81479
2026-03-28 11:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:14 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL39596%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for HL39596: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: JF88454
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF88454%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for JF88454: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: EZ85260
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ85260%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for EZ85260: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: RM57308
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM57308%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for RM57308: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: UF70444
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL43950%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for PL43950: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: KL28800
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL28800%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for KL28800: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: NB98056
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: GR21814
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR21814%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for GR21814: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: GK19760
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU93995%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for KU93995: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU54456%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for LU54456: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: EX28567
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX28567%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for EX28567: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: RA35463
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA43540%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for PA43540: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: KW12372
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA98182%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for HA98182: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: VY50847
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY50847%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for VY50847: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: TS51738
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: JA52917
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA52917%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for JA52917: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: NX72938
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX72938%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for NX72938: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM79545%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for FM79545: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: UR77276
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR77276%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for UR77276: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG51952%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for FG51952: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR63324%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for BR63324: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: LV60077
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL50797%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.es] INFO: Scrape type for VL50797: 0
2026-03-28 11:08:14 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-28 11:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:15 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:15 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-28 11:08:15 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB55193%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for FB55193: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: NM57742
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS14602%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for BS14602: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: SZ63984
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD79630%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for FD79630: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: ES89527
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES89527%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for ES89527: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: XY74308
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: JN45905
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: DW24133
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: WD04556
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD04556%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for WD04556: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: UC81403
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: BZ30519
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30519%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for BZ30519: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: WW50429
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: LL75884
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: ZB37818
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB37818%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for ZB37818: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: DY77667
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB64860%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for BB64860: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: RZ31529
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: EW95234
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS73380%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for ZS73380: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: YV96776
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV96776%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for YV96776: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: GA63026
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: VD82224
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: ZT77590
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF01083%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for VF01083: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY52551%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.es] INFO: Scrape type for ZY52551: 0
2026-03-28 11:08:16 [auto1.es] INFO: Found listing with ID: YF84144
2026-03-28 11:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:17 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: EN42971
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN42971%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for EN42971: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: PD68374
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: UD71414
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD71414%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for UD71414: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: KJ07748
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: RV91175
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: NL36775
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL36775%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for NL36775: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA45744%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for MA45744: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: FZ75347
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: NT89177
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT89177%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for NT89177: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC64345%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for ZC64345: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: XD17912
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY22174%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for RY22174: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: FG10684
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG10684%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for FG10684: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: FU47680
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH09218%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for CH09218: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: TF80262
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: YT73159
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT73159%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for YT73159: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: AU62151
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: CL10688
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL10688%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for CL10688: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: XH62171
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: DH48682
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: TU72670
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: CC38102
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC38102%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for CC38102: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: DT94982
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT94982%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for DT94982: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: GC28603
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC28603%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for GC28603: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: MC11095
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC11095%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for MC11095: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: NV62926
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: MA34031
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: KM76960
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM76960%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for KM76960: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: NK65007
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: TW71891
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW71891%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for TW71891: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: UD05464
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD05464%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.es] INFO: Scrape type for UD05464: 0
2026-03-28 11:08:17 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-28 11:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:18 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: XP71478
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB78010%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for BB78010: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: SP16189
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP16189%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for SP16189: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: LN74062
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN74062%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for LN74062: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09019%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for GT09019: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: FX97244
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK09082%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for SK09082: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: NY35082
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35082%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for NY35082: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL56851%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for JL56851: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF75670%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for JF75670: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: ZY41152
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: WT09242
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT09242%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for WT09242: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: KS85396
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS85396%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for KS85396: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB21971%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for FB21971: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: AG10118
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: YM84351
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU03494%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for EU03494: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: RF56388
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA81448%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for XA81448: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: RL15311
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: AD59112
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD59112%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for AD59112: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: FL29872
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL29872%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for FL29872: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: NK77548
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH13002%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for JH13002: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: VG51698
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ20616%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for XZ20616: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: WF62317
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF62317%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for WF62317: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: CU36803
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU36803%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for CU36803: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: EX93255
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX93255%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for EX93255: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: SH77373
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: XT63016
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT63016%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.es] INFO: Scrape type for XT63016: 0
2026-03-28 11:08:18 [auto1.es] INFO: Found listing with ID: KD18831
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD18831%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.es] INFO: Scrape type for KD18831: 0
2026-03-28 11:08:19 [auto1.es] INFO: Found listing with ID: UC02522
2026-03-28 11:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item fcd77e97-e526-57a7-8404-362f17856991 due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_22a38cc9ef0dd50e2a152d8db5473771.jpg took longer than 180.0 seconds..
2026-03-28 11:08:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 26591f7a-c0d4-563a-8053-ea96c484618f due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_c2bb40baa8d19545629743dba7ae92cb.jpg took longer than 180.0 seconds..
2026-03-28 11:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fcd77e97-e526-57a7-8404-362f17856991 with identifier: RE29158
2026-03-28 11:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fcd77e97-e526-57a7-8404-362f17856991 with identifier: RE29158
2026-03-28 11:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fcd77e97-e526-57a7-8404-362f17856991 with identifier: RE29158 to the API
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:20 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_41a91a8c5bdda7b5eba1d71ded28f28d.jpg took longer than 180.0 seconds..
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:14:56Z',
 'fuel_type': 'diesel',
 'id': 'fcd77e97-e526-57a7-8404-362f17856991',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE29158',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 171887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg',
                'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_6c6622f2722faad91e86871a9c197900.jpg',
                'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_9d8319331c46ad6d2678dd8936d67e29.jpg',
                'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_2180e17acda5d262b9a832412140a45a.jpg',
                'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_41a91a8c5bdda7b5eba1d71ded28f28d.jpg',
                'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_22a38cc9ef0dd50e2a152d8db5473771.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd77e97-e526-57a7-8404-362f17856991/fcd77e97-e526-57a7-8404-362f17856991_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_7ec75af5b5a6f9e29e92d867084efabf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd77e97-e526-57a7-8404-362f17856991/fcd77e97-e526-57a7-8404-362f17856991_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_6c6622f2722faad91e86871a9c197900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd77e97-e526-57a7-8404-362f17856991/fcd77e97-e526-57a7-8404-362f17856991_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_9d8319331c46ad6d2678dd8936d67e29.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE29158%27 HTTP/1.1" 200 None
2026-03-28 11:08:20 [auto1.es] INFO: Saving data for RE29158: {'created_time': 1774696100.935313, 'last_price_update_time': 1774696100.935324, 'auction_closing_time': 1774883696.0}
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RE29158') HTTP/1.1" 204 0
2026-03-28 11:08:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 26591f7a-c0d4-563a-8053-ea96c484618f due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_06abf1637036c846479dcbacf4de82d3.jpg took longer than 180.0 seconds..
2026-03-28 11:08:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item fcd77e97-e526-57a7-8404-362f17856991 due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img70/12/7012b4f37df25ce20fd02e59f0121c3a/pa/RE29158_41a91a8c5bdda7b5eba1d71ded28f28d.jpg took longer than 180.0 seconds..
2026-03-28 11:08:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 26591f7a-c0d4-563a-8053-ea96c484618f due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_3523d43f74a992384b1c9b3aa989198b.jpg took longer than 180.0 seconds..
2026-03-28 11:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26591f7a-c0d4-563a-8053-ea96c484618f with identifier: LJ76741
2026-03-28 11:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26591f7a-c0d4-563a-8053-ea96c484618f with identifier: LJ76741
2026-03-28 11:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26591f7a-c0d4-563a-8053-ea96c484618f with identifier: LJ76741 to the API
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:21 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2486fe68274ba03f7e34f29e75ceb2d0.jpg took longer than 180.0 seconds..
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:28:29Z',
 'fuel_type': 'diesel',
 'id': '26591f7a-c0d4-563a-8053-ea96c484618f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ76741',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 133176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_fdb71fa295a73221125faa62b14e86d7.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b8b9b70dc65d921b592590b05362a46b.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_8116a2a683681ee7b214e0c391c005d7.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b23e814dd667fb6d8428cdf4cd73a676.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2486fe68274ba03f7e34f29e75ceb2d0.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_06abf1637036c846479dcbacf4de82d3.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_c2bb40baa8d19545629743dba7ae92cb.jpg',
                'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_3523d43f74a992384b1c9b3aa989198b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_fdb71fa295a73221125faa62b14e86d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_b8b9b70dc65d921b592590b05362a46b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2fda83c5dd3b6ef52ae0093009105e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_8116a2a683681ee7b214e0c391c005d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26591f7a-c0d4-563a-8053-ea96c484618f/26591f7a-c0d4-563a-8053-ea96c484618f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_5c3aa30e0a7676e34ea4858fc5a508cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ76741%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Saving data for LJ76741: {'created_time': 1774696101.360439, 'last_price_update_time': 1774696101.360448, 'auction_closing_time': 1774884509.0}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ76741') HTTP/1.1" 204 0
2026-03-28 11:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 26591f7a-c0d4-563a-8053-ea96c484618f due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img82/a3/82a3458155fc10fe4413d7fd300d0757/pa/LJ76741_2486fe68274ba03f7e34f29e75ceb2d0.jpg took longer than 180.0 seconds..
2026-03-28 11:08:21 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: EV19134
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV19134%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Scrape type for EV19134: 0
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: UZ90788
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ90788%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Scrape type for UZ90788: 0
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: FU34465
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU34465%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Scrape type for FU34465: 0
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: YA75501
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: XA87642
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: XZ11402
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50380%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Scrape type for XS50380: 0
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD34626%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Scrape type for CD34626: 2
2026-03-28 11:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9579f35-e532-51d6-b86f-7d7f2339ba01 with identifier: CD34626
2026-03-28 11:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9579f35-e532-51d6-b86f-7d7f2339ba01 with scrape type 2
2026-03-28 11:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9579f35-e532-51d6-b86f-7d7f2339ba01 with scrape type 2
2026-03-28 11:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9579f35-e532-51d6-b86f-7d7f2339ba01, identifier: CD34626
2026-03-28 11:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9579f35-e532-51d6-b86f-7d7f2339ba01 with identifier: CD34626
2026-03-28 11:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9579f35-e532-51d6-b86f-7d7f2339ba01 with identifier: CD34626
2026-03-28 11:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9579f35-e532-51d6-b86f-7d7f2339ba01 with identifier: CD34626 to the API
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:28:04Z',
 'fuel_type': 'hybrid',
 'id': 'd9579f35-e532-51d6-b86f-7d7f2339ba01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD34626',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 232130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2017}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD34626%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.es] INFO: Saving data for CD34626: {'auction_closing_time': 1774715284.0, 'created_time': 1774512325.312235, 'last_price_update_time': 1774696101.968549}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CD34626') HTTP/1.1" 204 0
2026-03-28 11:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-28 11:08:21 [auto1.es] INFO: Found listing with ID: BS42122
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS42122%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for BS42122: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: SM85087
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: LS40670
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS40670%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for LS40670: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: RC86632
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR39906%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for RR39906: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: RU34223
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU34223%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for RU34223: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: GA97156
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA97156%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for GA97156: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: VW25923
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW25923%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for VW25923: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY21107%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for YY21107: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: HV14061
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: ZW86524
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: ZT59108
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT59108%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for ZT59108: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: XX07827
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX07827%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for XX07827: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: CU53246
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU53246%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for CU53246: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR10742%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for LR10742: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: VC56562
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC56562%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for VC56562: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: HB97411
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB97411%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for HB97411: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: ZS36669
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS36669%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for ZS36669: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: NJ98715
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY69585%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for VY69585: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: KB11280
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB11280%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for KB11280: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: AC97398
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: FK13380
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK13380%27 HTTP/1.1" 200 None
2026-03-28 11:08:22 [auto1.es] INFO: Scrape type for FK13380: 0
2026-03-28 11:08:22 [auto1.es] INFO: Found listing with ID: DD02893
2026-03-28 11:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:23 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: FJ48317
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ48317%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for FJ48317: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: TB67105
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: RJ57584
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ57584%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for RJ57584: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK07271%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for SK07271: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: CL69232
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ49849%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for XZ49849: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: ZF20558
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF20558%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for ZF20558: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: LA59477
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: WT51875
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: YJ22618
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22618%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for YJ22618: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: CY21718
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: EN57511
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN57511%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for EN57511: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: MJ86771
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: XW98344
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: HY26286
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY26286%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for HY26286: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: SL84888
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL84888%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for SL84888: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM92438%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for CM92438: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: EG03635
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: EM05584
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: DR35066
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR35066%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for DR35066: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: ZT41669
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB47883%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for LB47883: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: ZH70186
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH70186%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for ZH70186: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE54244%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for BE54244: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: FM46706
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: RC07486
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: PU52271
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW04171%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for JW04171: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: HF45963
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY74928%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for BY74928: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP77113%27 HTTP/1.1" 200 None
2026-03-28 11:08:23 [auto1.es] INFO: Scrape type for AP77113: 0
2026-03-28 11:08:23 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-28 11:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 with identifier: PE66788
2026-03-28 11:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 with identifier: PE66788
2026-03-28 11:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 with identifier: PE66788 to the API
2026-03-28 11:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:25 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_3ad6b3c8128700122c599fc43dca7179.jpg took longer than 180.0 seconds..
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:58:09Z',
 'fuel_type': 'diesel',
 'id': '8d7dc2dd-8023-5ede-9d99-c701ee3a64a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE66788',
 'listing': 'auction',
 'location': 'ES, Leioa',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 99049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_39a0bb7b96df1045cfc731c73b192718.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_43450ef2169baea43e80d3773dd75501.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_175a39c39748089c9714e82a794985df.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6f804d164e0014bb1819e266b0d3deec.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6b92421bdab085930d6e9dc320457663.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_145d78e316225d7fe616fa3369c8b2d2.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_3ad6b3c8128700122c599fc43dca7179.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg',
                'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_eb3faa53d9c09d394dd2307f760cc248.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_39a0bb7b96df1045cfc731c73b192718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_43450ef2169baea43e80d3773dd75501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_175a39c39748089c9714e82a794985df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_6b92421bdab085930d6e9dc320457663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_0a9d6c57b7c23c3f8ddf44ab1d912457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_f6dff14f19636da02d4c7eb430bb32f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7dc2dd-8023-5ede-9d99-c701ee3a64a5/8d7dc2dd-8023-5ede-9d99-c701ee3a64a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_eb3faa53d9c09d394dd2307f760cc248.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE66788%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Saving data for PE66788: {'created_time': 1774696105.194762, 'last_price_update_time': 1774696105.194771, 'auction_closing_time': 1774886289.0}
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE66788') HTTP/1.1" 204 0
2026-03-28 11:08:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 8d7dc2dd-8023-5ede-9d99-c701ee3a64a5 due to User timeout caused connection failure: Getting https://img-pa.auto1.com/img71/bd/71bdd31d2894242668fc7074e86d49fc/pa/PE66788_3ad6b3c8128700122c599fc43dca7179.jpg took longer than 180.0 seconds..
2026-03-28 11:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:25 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH68821%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for UH68821: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: FJ96130
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: JJ77360
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ77360%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for JJ77360: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: SR69249
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: RG81713
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG81713%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for RG81713: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: NC65740
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC65740%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for NC65740: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: MP83522
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: ZV33545
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL92788%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for GL92788: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: XH10437
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH10437%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for XH10437: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN05964%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for JN05964: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: KW20253
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW20253%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for KW20253: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL32724%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for ZL32724: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: YF74611
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF74611%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for YF74611: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC57455%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for WC57455: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU51978%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for YU51978: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: LY65055
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY65055%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for LY65055: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: NF74888
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF74888%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for NF74888: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: DH03412
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: XR15363
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV83587%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for JV83587: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: SN56696
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV15787%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for XV15787: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR40817%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for FR40817: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU83574%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for BU83574: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: HV80518
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: YP61713
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP61713%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for YP61713: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: SP65649
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: KP20621
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP20621%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for KP20621: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: NA52413
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA52413%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for NA52413: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: ZE77964
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE77964%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for ZE77964: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA77291%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for WA77291: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: EU16511
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU16511%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for EU16511: 0
2026-03-28 11:08:25 [auto1.es] INFO: Found listing with ID: PF18321
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF18321%27 HTTP/1.1" 200 None
2026-03-28 11:08:25 [auto1.es] INFO: Scrape type for PF18321: 0
2026-03-28 11:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:28 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: ZF17550
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF17550%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for ZF17550: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: DY05510
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC76181%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for YC76181: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: XH10383
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH10383%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for XH10383: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: SF23835
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF23835%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for SF23835: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: JZ74348
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: EV57307
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: DB91286
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: US16617
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US16617%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for US16617: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ32916%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for UZ32916: 2
2026-03-28 11:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26b8f00-734d-5203-a6c5-dd9f506bcc80 with identifier: UZ32916
2026-03-28 11:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26b8f00-734d-5203-a6c5-dd9f506bcc80 with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f26b8f00-734d-5203-a6c5-dd9f506bcc80 with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f26b8f00-734d-5203-a6c5-dd9f506bcc80, identifier: UZ32916
2026-03-28 11:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f26b8f00-734d-5203-a6c5-dd9f506bcc80 with identifier: UZ32916
2026-03-28 11:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f26b8f00-734d-5203-a6c5-dd9f506bcc80 with identifier: UZ32916
2026-03-28 11:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f26b8f00-734d-5203-a6c5-dd9f506bcc80 with identifier: UZ32916 to the API
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:03Z',
 'fuel_type': 'diesel',
 'id': 'f26b8f00-734d-5203-a6c5-dd9f506bcc80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ32916',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 327446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ32916%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Saving data for UZ32916: {'auction_closing_time': 1774714863.0, 'created_time': 1774512326.734764, 'last_price_update_time': 1774696108.546969}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ32916') HTTP/1.1" 204 0
2026-03-28 11:08:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58937%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for KH58937: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: BB21726
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: VE25065
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE25065%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for VE25065: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: VC51874
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC51874%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for VC51874: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: HB80191
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH44076%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for EH44076: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: WP31785
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: NA45690
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW07664%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for XW07664: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: UL26650
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL26650%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for UL26650: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN60622%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for PN60622: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: BE55826
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: MR13736
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: XY73701
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY73701%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for XY73701: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: NJ64367
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ64367%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for NJ64367: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: MU84560
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: NP28736
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP28736%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for NP28736: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: BE57585
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: LZ46895
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: ZK08967
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: MF18812
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF18812%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for MF18812: 0
2026-03-28 11:08:28 [auto1.es] INFO: Found listing with ID: VX73239
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX73239%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.es] INFO: Scrape type for VX73239: 0
2026-03-28 11:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:30 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: GS37711
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: HE26407
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE26407%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for HE26407: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: CH37145
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH37145%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for CH37145: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: YX91165
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX91165%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for YX91165: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: PM01444
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM01444%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for PM01444: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: CG97821
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG97821%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for CG97821: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: ES67704
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES67704%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for ES67704: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: UF98716
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: UV98686
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV98686%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for UV98686: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: ZL46614
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL46614%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for ZL46614: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: CF72772
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF72772%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for CF72772: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: CD32787
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD32787%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for CD32787: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: ME11919
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: YU32195
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU32195%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for YU32195: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE05235%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for HE05235: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: GE49904
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: UX45403
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: PY10364
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY10364%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for PY10364: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: FY36073
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: HM53954
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: KE93313
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE93313%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for KE93313: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: GX93030
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX93030%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for GX93030: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: DS99682
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS99682%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for DS99682: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: WV40532
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV40532%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for WV40532: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: KC53673
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: SM25064
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP42129%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for MP42129: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: US76988
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: WE46909
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE46909%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for WE46909: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: GJ58304
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ58304%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for GJ58304: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU07288%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for SU07288: 0
2026-03-28 11:08:30 [auto1.es] INFO: Found listing with ID: RN04683
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN04683%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.es] INFO: Scrape type for RN04683: 0
2026-03-28 11:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:31 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT62572%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for GT62572: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: SA21904
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: CU63126
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU63126%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for CU63126: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: PS40392
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS40392%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for PS40392: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: ER70032
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER70032%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for ER70032: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: NB66504
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB66504%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for NB66504: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR16993%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for AR16993: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: AE99486
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE99486%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for AE99486: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: ST64769
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR73846%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for BR73846: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: NZ52735
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ52735%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for NZ52735: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: VG19915
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX90216%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for JX90216: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW69130%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for WW69130: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: DB60699
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: MD84451
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: FF27063
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM76074%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for FM76074: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: FN47664
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN47664%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for FN47664: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: PX56700
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX56700%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for PX56700: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: LE05631
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: YA92841
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: WJ47895
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ47895%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for WJ47895: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: BP83698
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: UY61522
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY61522%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for UY61522: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: FP96823
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP96823%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for FP96823: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: MT75330
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT75330%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.es] INFO: Scrape type for MT75330: 0
2026-03-28 11:08:31 [auto1.es] INFO: Found listing with ID: CY83374
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY83374%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for CY83374: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: CA59744
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA59744%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for CA59744: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: GZ65139
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65139%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for GZ65139: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: SV82730
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV82730%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for SV82730: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT34308%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for GT34308: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: VE56967
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: YG49669
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: XX51310
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX51310%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for XX51310: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: NZ53366
2026-03-28 11:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:32 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: HA69691
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: BR02548
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: CK45240
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK45240%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for CK45240: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: NT11654
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT11654%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for NT11654: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: FU44920
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU44920%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for FU44920: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH18424%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.es] INFO: Scrape type for CH18424: 0
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: KR74310
2026-03-28 11:08:32 [auto1.es] INFO: Found listing with ID: HL87277
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL87277%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for HL87277: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: ZS52106
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: GA48296
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA48296%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for GA48296: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: PV57289
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: DH51017
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH51017%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for DH51017: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: YS24805
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: KK62636
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: GP88698
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: UE51591
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: KK88543
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK88543%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for KK88543: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: SJ54893
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ54893%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for SJ54893: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: UR77549
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR77549%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for UR77549: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: RH13684
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: RR88978
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR88978%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for RR88978: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: VM33646
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: TN33358
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN33358%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for TN33358: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: JR18467
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR18467%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for JR18467: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: WH79046
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH97828%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for YH97828: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: EG55234
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG55234%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for EG55234: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: JY61710
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY61710%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for JY61710: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: MZ20228
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ20228%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for MZ20228: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: NF49332
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: GP02900
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ92656%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for TJ92656: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ35606%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for TJ35606: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: JL87579
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL87579%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for JL87579: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU50273%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for CU50273: 0
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: KA14000
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: LU77013
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: UN54067
2026-03-28 11:08:33 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB66984%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.es] INFO: Scrape type for EB66984: 0
2026-03-28 11:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:34 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: LE92322
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE92322%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for LE92322: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: FK94642
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK94642%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for FK94642: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: RF34421
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: MF83182
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: UJ15106
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: SX47256
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL38815%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for TL38815: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: AY17458
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: AX44077
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: LR05195
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: ED43827
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: WE77493
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: TK05995
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK05995%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for TK05995: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: RE01082
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE01082%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for RE01082: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: VR51792
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR51792%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for VR51792: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: WW04715
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP98864%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for LP98864: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: CL84602
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL84602%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for CL84602: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: CB44972
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB44972%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for CB44972: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: CM66780
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ18297%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for NJ18297: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: FL72079
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: CD37802
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD37802%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for CD37802: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: KR53631
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: RH73314
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH73314%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for RH73314: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: FM03469
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK97910%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for DK97910: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: TZ12338
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE32558%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for UE32558: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL42593%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for BL42593: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM70741%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for CM70741: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM51869%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for SM51869: 0
2026-03-28 11:08:34 [auto1.es] INFO: Found listing with ID: DU33012
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU33012%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.es] INFO: Scrape type for DU33012: 0
2026-03-28 11:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:36 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: LV62700
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV62700%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for LV62700: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: KT03520
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: PR26492
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61689%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for MA61689: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: NG44542
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG44542%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for NG44542: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: FT82115
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT82115%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for FT82115: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: EK45789
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: KZ85278
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: NN86390
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD24315%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for MD24315: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER91055%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for ER91055: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX17134%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for MX17134: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK31632%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for RK31632: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC23738%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for JC23738: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF11976%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for DF11976: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: FK36826
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: EV43622
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR08098%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for DR08098: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: VR55239
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR55239%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for VR55239: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: JM46031
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR06074%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for UR06074: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU03691%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for DU03691: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK29060%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for BK29060: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38723%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for NC38723: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: GA23722
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: UB92538
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB92538%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for UB92538: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: LW24131
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW24131%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for LW24131: 0
2026-03-28 11:08:36 [auto1.es] INFO: Found listing with ID: JH23969
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH23969%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.es] INFO: Scrape type for JH23969: 0
2026-03-28 11:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:38 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:38 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-28 11:08:38 [auto1.es] INFO: Found listing with ID: AD94776
2026-03-28 11:08:38 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-28 11:08:38 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-28 11:08:38 [auto1.es] INFO: Found listing with ID: HW14857
2026-03-28 11:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW14857%27 HTTP/1.1" 200 None
2026-03-28 11:08:38 [auto1.es] INFO: Scrape type for HW14857: 0
2026-03-28 11:08:38 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-28 11:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP76490%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for YP76490: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD88168%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for KD88168: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ15003%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for MJ15003: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX46671%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for BX46671: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: KA10637
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: RK54634
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK54634%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for RK54634: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF73149%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for YF73149: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: NM67545
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: FX35940
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX35940%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for FX35940: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: KA04822
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA04822%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for KA04822: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: MS70085
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK48295%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for SK48295: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: RD09772
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD09772%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for RD09772: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG46245%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for FG46245: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV12911%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for SV12911: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: SW56869
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW56869%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for SW56869: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB55085%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for HB55085: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: XY62505
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY62505%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for XY62505: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: VC51295
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: ZU80420
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU80420%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for ZU80420: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: CX94622
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX94622%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for CX94622: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: CV01854
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: NH75257
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH75257%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for NH75257: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: MC91810
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC91810%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for MC91810: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX41705%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for XX41705: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: WC11174
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC11174%27 HTTP/1.1" 200 None
2026-03-28 11:08:39 [auto1.es] INFO: Scrape type for WC11174: 0
2026-03-28 11:08:39 [auto1.es] INFO: Found listing with ID: TX02907
2026-03-28 11:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:40 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU11910%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for RU11910: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR81111%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for MR81111: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: AG64385
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: DE89755
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE89755%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for DE89755: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: FD55064
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD55064%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for FD55064: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ21581%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for ZZ21581: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: TS70412
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: GU38907
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU38907%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for GU38907: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: ZD47887
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD47887%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for ZD47887: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: RX29075
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX29075%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for RX29075: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: DD64860
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: YC67276
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: BT53297
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for BT53297: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: EY80222
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ06814%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for GJ06814: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: YJ20703
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF19420%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for LF19420: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: RK37999
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK37999%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for RK37999: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: VB75549
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB75549%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for VB75549: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: YV46157
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: MK48449
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: VV60127
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV60127%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for VV60127: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: RD28906
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD28906%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for RD28906: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: YC39574
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC39574%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for YC39574: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET46210%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for ET46210: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: WG59071
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: TF20925
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF20925%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for TF20925: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: JG54829
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG54829%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for JG54829: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: AS80806
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: ZG70058
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG70058%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.es] INFO: Scrape type for ZG70058: 0
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: YH51023
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: CJ84501
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: HH76274
2026-03-28 11:08:40 [auto1.es] INFO: Found listing with ID: LJ17115
2026-03-28 11:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:42 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: FG05757
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG05757%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for FG05757: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: DB89419
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB89419%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for DB89419: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA57781%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for LA57781: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: RD28331
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD28331%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for RD28331: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: TW26676
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW26676%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for TW26676: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: GP55698
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP55698%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for GP55698: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: RG56357
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: SW63270
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW63270%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for SW63270: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: FH92259
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH92259%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for FH92259: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: WN06367
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: HM29961
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: XC57294
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC57294%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for XC57294: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU98432%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.es] INFO: Scrape type for EU98432: 0
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: RY15229
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: DW75083
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: RL87551
2026-03-28 11:08:42 [auto1.es] INFO: Found listing with ID: KN45266
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN45266%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for KN45266: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: EL62965
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL62965%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for EL62965: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: XG96540
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG96540%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for XG96540: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: AB25333
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: WG96659
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: JM59673
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM59673%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for JM59673: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: GL31739
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL31739%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for GL31739: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: ZB83445
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: ZL80540
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for ZL80540: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: PY12516
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: ZY07880
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG14230%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for UG14230: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: WD56273
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: WJ13059
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13059%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for WJ13059: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: PB42278
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB42278%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for PB42278: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: GH53615
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: TD30027
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD30027%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for TD30027: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: FA27463
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27463%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for FA27463: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: MR66674
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: FA20187
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA20187%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for FA20187: 0
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: XB66018
2026-03-28 11:08:43 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES48862%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.es] INFO: Scrape type for ES48862: 0
2026-03-28 11:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:44 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: AN82065
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN82065%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for AN82065: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: AP65187
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05662%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for EZ05662: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: GR17806
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR17806%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for GR17806: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: PW69748
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW69748%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for PW69748: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: LM78815
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP48517%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for XP48517: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD74793%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for DD74793: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: VF19120
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF19120%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for VF19120: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: NM32585
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM32585%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for NM32585: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: PY80888
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY80888%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for PY80888: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: RA61754
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: TS18952
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: GG84553
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: VY77417
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: LS36094
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: CR47918
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: HF65167
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: GG33729
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG33729%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for GG33729: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: RD19726
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: FJ71193
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: JX94297
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: RC43522
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: EH10088
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH10088%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for EH10088: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: FB98424
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: GA24285
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA24285%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for GA24285: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: EL53937
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL53937%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for EL53937: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: MN81981
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: RG01927
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: WE77223
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE77223%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for WE77223: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: SL38190
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL38190%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for SL38190: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: KT38971
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW28611%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for PW28611: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: LZ88229
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: YM10014
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: BM84951
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: FX21213
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX21213%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for FX21213: 0
2026-03-28 11:08:44 [auto1.es] INFO: Found listing with ID: JG12549
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG12549%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.es] INFO: Scrape type for JG12549: 0
2026-03-28 11:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:45 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2560 | hits on page: 40
2026-03-28 11:08:45 [auto1.es] INFO: Found listing with ID: HK65705
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK65705%27 HTTP/1.1" 200 None
2026-03-28 11:08:45 [auto1.es] INFO: Scrape type for HK65705: 0
2026-03-28 11:08:45 [auto1.es] INFO: Found listing with ID: WN81450
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN81450%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for WN81450: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: TG06683
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: RK21190
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK21190%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for RK21190: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: AL55124
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: BX87783
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: UN21453
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: KF67108
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF67108%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for KF67108: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: HN15529
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN15529%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for HN15529: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: WZ09714
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT72542%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for GT72542: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: NC85422
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: NG03443
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: ZM94527
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: ZY05184
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: XB60101
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: DS53595
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS53595%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for DS53595: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: JK89410
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: KT73774
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT73774%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for KT73774: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: DN57812
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: GF25247
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF25247%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for GF25247: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: GY71785
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY71785%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for GY71785: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: TB59452
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: JG20309
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG20309%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for JG20309: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: LF34637
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF34637%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for LF34637: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: TA37328
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA37328%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for TA37328: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS63423%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for KS63423: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: SU90916
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU90916%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for SU90916: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: YJ60609
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: TB20827
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: JR41621
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR41621%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for JR41621: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR11017%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for RR11017: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: HC78450
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC78450%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for HC78450: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: VE86539
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: SB05981
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB05981%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for SB05981: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: GH64040
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH64040%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.es] INFO: Scrape type for GH64040: 0
2026-03-28 11:08:46 [auto1.es] INFO: Found listing with ID: US21221
2026-03-28 11:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:47 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2561 | hits on page: 40
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: US21221
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: SB85910
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB85910%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for SB85910: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: WZ08736
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ08736%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for WZ08736: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: YH80645
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH80645%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for YH80645: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: FW08254
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: PK70837
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: EG02791
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG02791%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for EG02791: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: DF32061
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: JA56838
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA56838%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for JA56838: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: YD78878
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: BB57842
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: FP11877
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: XS07722
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS07722%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for XS07722: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM50481%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for SM50481: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: AM60182
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM60182%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for AM60182: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: WR08352
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: GY73641
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: LB26536
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: FE19310
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE19310%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for FE19310: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: XB79448
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: ME14626
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: HS01643
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS01643%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for HS01643: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: CF60022
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF60022%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for CF60022: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: TP19820
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: UP13396
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP13396%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for UP13396: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: HF43157
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: RD87944
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV56361%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for LV56361: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: TW64158
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW64158%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for TW64158: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: KU36165
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU36165%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for KU36165: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: FG19732
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG19732%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for FG19732: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: BP57031
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: RY21508
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: FV98550
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for FV98550: 0
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: NN72545
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: PX05110
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: VK69645
2026-03-28 11:08:47 [auto1.es] INFO: Found listing with ID: MV52589
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV52589%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.es] INFO: Scrape type for MV52589: 0
2026-03-28 11:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:48 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2561 | hits on page: 40
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: YT36266
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT36266%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for YT36266: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: BM28897
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: YJ05760
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: PH65326
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: ED82323
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: YF71759
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF71759%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for YF71759: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: HJ36466
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ36466%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for HJ36466: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: AC34566
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: SV63508
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV63508%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for SV63508: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: XR63585
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR63585%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for XR63585: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: FM92662
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM92662%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for FM92662: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG55317%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for LG55317: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: DY55894
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY55894%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for DY55894: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: EZ26896
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ26896%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for EZ26896: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: WA45592
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: BG56736
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG56736%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for BG56736: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: KH43607
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH43607%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for KH43607: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE39278%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for EE39278: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: XZ84742
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ84742%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for XZ84742: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: BK86158
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK86158%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for BK86158: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: BU12450
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU12450%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.es] INFO: Scrape type for BU12450: 0
2026-03-28 11:08:48 [auto1.es] INFO: Found listing with ID: UB63669
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB63669%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for UB63669: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: NP13134
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP13134%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for NP13134: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: ES80363
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA66808%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for NA66808: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: GH55887
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH55887%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for GH55887: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: WA42706
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: UJ02953
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ02953%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for UJ02953: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: ZZ48834
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ48834%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for ZZ48834: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ40506%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for VJ40506: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: GZ65389
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: WU84058
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU84058%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for WU84058: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: ZN70323
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN70323%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for ZN70323: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: JD05776
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD05776%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for JD05776: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT28887%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for ZT28887: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: KF15980
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF15980%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for KF15980: 0
2026-03-28 11:08:49 [auto1.es] INFO: Found listing with ID: XH14423
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH14423%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.es] INFO: Scrape type for XH14423: 0
2026-03-28 11:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:50 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2561 | hits on page: 40
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: BK45760
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: TR57503
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR57503%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for TR57503: 0
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: XW97577
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: PF88217
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: EG85848
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ66881%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for UZ66881: 0
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL63813%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for BL63813: 0
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN12947%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for EN12947: 0
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: ZV69106
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: EP39863
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: WW33252
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW33252%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for WW33252: 0
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: GK53380
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK53380%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for GK53380: 0
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: GX06456
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: MV28926
2026-03-28 11:08:50 [auto1.es] INFO: Found listing with ID: HZ84403
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84403%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.es] INFO: Scrape type for HZ84403: 2
2026-03-28 11:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403
2026-03-28 11:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0338dbe7-ace5-537d-81ca-ea17c7f55721 with scrape type 2
2026-03-28 11:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0338dbe7-ace5-537d-81ca-ea17c7f55721 with scrape type 2
2026-03-28 11:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0338dbe7-ace5-537d-81ca-ea17c7f55721, identifier: HZ84403
2026-03-28 11:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403
2026-03-28 11:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403
2026-03-28 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403 to the API
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:05:09Z',
 'fuel_type': 'petrol',
 'id': '0338dbe7-ace5-537d-81ca-ea17c7f55721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ84403',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 160569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2020}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84403%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.es] INFO: Saving data for HZ84403: {'auction_closing_time': 1774713909.0, 'created_time': 1773126771.851562, 'last_price_update_time': 1774696131.217761}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ84403') HTTP/1.1" 204 0
2026-03-28 11:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:51 [auto1.es] INFO: Found listing with ID: SN85132
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN85132%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.es] INFO: Scrape type for SN85132: 2
2026-03-28 11:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42201903-c196-5c7e-b87c-a65d7f145428 with identifier: SN85132
2026-03-28 11:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42201903-c196-5c7e-b87c-a65d7f145428 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42201903-c196-5c7e-b87c-a65d7f145428 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42201903-c196-5c7e-b87c-a65d7f145428, identifier: SN85132
2026-03-28 11:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42201903-c196-5c7e-b87c-a65d7f145428 with identifier: SN85132
2026-03-28 11:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42201903-c196-5c7e-b87c-a65d7f145428 with identifier: SN85132
2026-03-28 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42201903-c196-5c7e-b87c-a65d7f145428 with identifier: SN85132 to the API
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:08:59Z',
 'fuel_type': 'petrol',
 'id': '42201903-c196-5c7e-b87c-a65d7f145428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN85132',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 214282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN85132%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.es] INFO: Saving data for SN85132: {'auction_closing_time': 1774714139.0, 'created_time': 1773127054.371481, 'last_price_update_time': 1774696131.683102}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SN85132') HTTP/1.1" 204 0
2026-03-28 11:08:51 [auto1.es] INFO: Found listing with ID: PZ83937
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ83937%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.es] INFO: Scrape type for PZ83937: 2
2026-03-28 11:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4 with identifier: PZ83937
2026-03-28 11:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4, identifier: PZ83937
2026-03-28 11:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4 with identifier: PZ83937
2026-03-28 11:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4 with identifier: PZ83937
2026-03-28 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4 with identifier: PZ83937 to the API
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'f7bd086b-75cf-5162-8bc3-c1bcbf7e9ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ83937',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 198598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ83937%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.es] INFO: Saving data for PZ83937: {'auction_closing_time': 1774715591.0, 'created_time': 1774609537.223099, 'last_price_update_time': 1774696132.065485}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ83937') HTTP/1.1" 204 0
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: MJ22507
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: WA67007
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: AX74159
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: SL25416
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL25416%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.es] INFO: Scrape type for SL25416: 2
2026-03-28 11:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416
2026-03-28 11:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2bfe1f81-fb7d-5ed4-b080-04fc82149486, identifier: SL25416
2026-03-28 11:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416
2026-03-28 11:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416
2026-03-28 11:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416 to the API
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:04:25Z',
 'fuel_type': 'diesel',
 'id': '2bfe1f81-fb7d-5ed4-b080-04fc82149486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL25416',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 106761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL25416%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.es] INFO: Saving data for SL25416: {'auction_closing_time': 1774713865.0, 'created_time': 1773126768.975736, 'last_price_update_time': 1774696132.540062}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL25416') HTTP/1.1" 204 0
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG82225%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.es] INFO: Scrape type for GG82225: 2
2026-03-28 11:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200997a5-dd53-553d-8199-5584246993a3 with identifier: GG82225
2026-03-28 11:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200997a5-dd53-553d-8199-5584246993a3 with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200997a5-dd53-553d-8199-5584246993a3 with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 200997a5-dd53-553d-8199-5584246993a3, identifier: GG82225
2026-03-28 11:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 200997a5-dd53-553d-8199-5584246993a3 with identifier: GG82225
2026-03-28 11:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 200997a5-dd53-553d-8199-5584246993a3 with identifier: GG82225
2026-03-28 11:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 200997a5-dd53-553d-8199-5584246993a3 with identifier: GG82225 to the API
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:30:48Z',
 'fuel_type': 'diesel',
 'id': '200997a5-dd53-553d-8199-5584246993a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG82225',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 145115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG82225%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.es] INFO: Saving data for GG82225: {'auction_closing_time': 1774715448.0, 'created_time': 1774037427.669239, 'last_price_update_time': 1774696132.912333}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GG82225') HTTP/1.1" 204 0
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: LV49535
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: DJ04712
2026-03-28 11:08:52 [auto1.es] INFO: Found listing with ID: GX78430
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX78430%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.es] INFO: Scrape type for GX78430: 2
2026-03-28 11:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d with identifier: GX78430
2026-03-28 11:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d, identifier: GX78430
2026-03-28 11:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d with identifier: GX78430
2026-03-28 11:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d with identifier: GX78430
2026-03-28 11:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d with identifier: GX78430 to the API
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'diesel',
 'id': 'fcbc8957-4eb3-5af6-8fc1-1b1ce4916a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX78430',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 117201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX78430%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.es] INFO: Saving data for GX78430: {'auction_closing_time': 1774714816.0, 'created_time': 1773126763.096527, 'last_price_update_time': 1774696133.311724}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GX78430') HTTP/1.1" 204 0
2026-03-28 11:08:53 [auto1.es] INFO: Found listing with ID: XA13214
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA13214%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.es] INFO: Scrape type for XA13214: 2
2026-03-28 11:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 087400a1-6d32-5851-9c67-cef9b78c8082 with identifier: XA13214
2026-03-28 11:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 087400a1-6d32-5851-9c67-cef9b78c8082 with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 087400a1-6d32-5851-9c67-cef9b78c8082 with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 087400a1-6d32-5851-9c67-cef9b78c8082, identifier: XA13214
2026-03-28 11:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 087400a1-6d32-5851-9c67-cef9b78c8082 with identifier: XA13214
2026-03-28 11:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 087400a1-6d32-5851-9c67-cef9b78c8082 with identifier: XA13214
2026-03-28 11:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 087400a1-6d32-5851-9c67-cef9b78c8082 with identifier: XA13214 to the API
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:47Z',
 'fuel_type': 'diesel',
 'id': '087400a1-6d32-5851-9c67-cef9b78c8082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA13214',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 202838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Trend Edition',
 'transmission': 'manual',
 'trim': 'Trend Edition',
 'year': 2020}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA13214%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.es] INFO: Saving data for XA13214: {'auction_closing_time': 1774714127.0, 'created_time': 1774361485.592482, 'last_price_update_time': 1774696133.683538}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XA13214') HTTP/1.1" 204 0
2026-03-28 11:08:53 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH50909%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.es] INFO: Scrape type for XH50909: 2
2026-03-28 11:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab with identifier: XH50909
2026-03-28 11:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab, identifier: XH50909
2026-03-28 11:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab with identifier: XH50909
2026-03-28 11:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab with identifier: XH50909
2026-03-28 11:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8096ada1-60a8-5ffd-8d99-46ffbf2dfbab with identifier: XH50909 to the API
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'diesel',
 'id': '8096ada1-60a8-5ffd-8d99-46ffbf2dfbab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH50909',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 95508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2017}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH50909%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.es] INFO: Saving data for XH50909: {'auction_closing_time': 1774716963.0, 'created_time': 1774609530.861462, 'last_price_update_time': 1774696134.144822}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH50909') HTTP/1.1" 204 0
2026-03-28 11:08:54 [auto1.es] INFO: Found listing with ID: DE67964
2026-03-28 11:08:54 [auto1.es] INFO: Found listing with ID: TX42049
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX42049%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.es] INFO: Scrape type for TX42049: 2
2026-03-28 11:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b745fb6-f4b5-5cd7-bb35-de1821aaf533 with identifier: TX42049
2026-03-28 11:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b745fb6-f4b5-5cd7-bb35-de1821aaf533 with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b745fb6-f4b5-5cd7-bb35-de1821aaf533 with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b745fb6-f4b5-5cd7-bb35-de1821aaf533, identifier: TX42049
2026-03-28 11:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b745fb6-f4b5-5cd7-bb35-de1821aaf533 with identifier: TX42049
2026-03-28 11:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b745fb6-f4b5-5cd7-bb35-de1821aaf533 with identifier: TX42049
2026-03-28 11:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b745fb6-f4b5-5cd7-bb35-de1821aaf533 with identifier: TX42049 to the API
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:27:54Z',
 'fuel_type': 'petrol',
 'id': '9b745fb6-f4b5-5cd7-bb35-de1821aaf533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX42049',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 122755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2017}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX42049%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.es] INFO: Saving data for TX42049: {'auction_closing_time': 1774715274.0, 'created_time': 1774609545.267382, 'last_price_update_time': 1774696134.528979}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX42049') HTTP/1.1" 204 0
2026-03-28 11:08:54 [auto1.es] INFO: Found listing with ID: SG65714
2026-03-28 11:08:54 [auto1.es] INFO: Found listing with ID: XJ18059
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ18059%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.es] INFO: Scrape type for XJ18059: 2
2026-03-28 11:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b375a77c-d5b2-5780-8c8f-7602c2906b27 with identifier: XJ18059
2026-03-28 11:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b375a77c-d5b2-5780-8c8f-7602c2906b27 with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b375a77c-d5b2-5780-8c8f-7602c2906b27 with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b375a77c-d5b2-5780-8c8f-7602c2906b27, identifier: XJ18059
2026-03-28 11:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b375a77c-d5b2-5780-8c8f-7602c2906b27 with identifier: XJ18059
2026-03-28 11:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b375a77c-d5b2-5780-8c8f-7602c2906b27 with identifier: XJ18059
2026-03-28 11:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b375a77c-d5b2-5780-8c8f-7602c2906b27 with identifier: XJ18059 to the API
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:14:55Z',
 'fuel_type': 'diesel',
 'id': 'b375a77c-d5b2-5780-8c8f-7602c2906b27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ18059',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Frontera',
 'odometer': 220141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-02-11',
 'seller_name': None,
 'title': 'Opel Frontera 2.3 Turbodiesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 1993}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ18059%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.es] INFO: Saving data for XJ18059: {'auction_closing_time': 1774714495.0, 'created_time': 1774609539.616451, 'last_price_update_time': 1774696134.936708}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ18059') HTTP/1.1" 204 0
2026-03-28 11:08:54 [auto1.es] INFO: Found listing with ID: CY15368
2026-03-28 11:08:54 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP27315%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.es] INFO: Scrape type for UP27315: 2
2026-03-28 11:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabb541b-41a8-5b95-9727-3484fc9cd12c with identifier: UP27315
2026-03-28 11:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabb541b-41a8-5b95-9727-3484fc9cd12c with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eabb541b-41a8-5b95-9727-3484fc9cd12c with scrape type 2
2026-03-28 11:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eabb541b-41a8-5b95-9727-3484fc9cd12c, identifier: UP27315
2026-03-28 11:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eabb541b-41a8-5b95-9727-3484fc9cd12c with identifier: UP27315
2026-03-28 11:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eabb541b-41a8-5b95-9727-3484fc9cd12c with identifier: UP27315
2026-03-28 11:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eabb541b-41a8-5b95-9727-3484fc9cd12c with identifier: UP27315 to the API
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:13Z',
 'fuel_type': 'diesel',
 'id': 'eabb541b-41a8-5b95-9727-3484fc9cd12c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP27315',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa 159',
 'odometer': 300224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-29',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 159 1.9 JTD JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'JTDM Distinctive',
 'year': 2005}
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP27315%27 HTTP/1.1" 200 None
2026-03-28 11:08:55 [auto1.es] INFO: Saving data for UP27315: {'auction_closing_time': 1774714333.0, 'created_time': 1774037148.763389, 'last_price_update_time': 1774696135.642435}
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP27315') HTTP/1.1" 204 0
2026-03-28 11:08:55 [auto1.es] INFO: Found listing with ID: JG12289
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG12289%27 HTTP/1.1" 200 None
2026-03-28 11:08:55 [auto1.es] INFO: Scrape type for JG12289: 2
2026-03-28 11:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36193249-da14-59db-8dbb-62f5f80b3e50 with identifier: JG12289
2026-03-28 11:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36193249-da14-59db-8dbb-62f5f80b3e50 with scrape type 2
2026-03-28 11:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36193249-da14-59db-8dbb-62f5f80b3e50 with scrape type 2
2026-03-28 11:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36193249-da14-59db-8dbb-62f5f80b3e50, identifier: JG12289
2026-03-28 11:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36193249-da14-59db-8dbb-62f5f80b3e50 with identifier: JG12289
2026-03-28 11:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36193249-da14-59db-8dbb-62f5f80b3e50 with identifier: JG12289
2026-03-28 11:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36193249-da14-59db-8dbb-62f5f80b3e50 with identifier: JG12289 to the API
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:34:14Z',
 'fuel_type': 'diesel',
 'id': '36193249-da14-59db-8dbb-62f5f80b3e50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG12289',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 145300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2021}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG12289%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.es] INFO: Saving data for JG12289: {'auction_closing_time': 1774715654.0, 'created_time': 1773127066.839838, 'last_price_update_time': 1774696136.066741}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG12289') HTTP/1.1" 204 0
2026-03-28 11:08:56 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2561 | hits on page: 40
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: HT69965
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW14097%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.es] INFO: Scrape type for KW14097: 2
2026-03-28 11:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097
2026-03-28 11:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91f10fb-e694-5e41-b57a-e04caf11fa2f with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f91f10fb-e694-5e41-b57a-e04caf11fa2f with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f91f10fb-e694-5e41-b57a-e04caf11fa2f, identifier: KW14097
2026-03-28 11:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097
2026-03-28 11:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097
2026-03-28 11:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097 to the API
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:28:02Z',
 'fuel_type': 'petrol',
 'id': 'f91f10fb-e694-5e41-b57a-e04caf11fa2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW14097',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 25308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-13',
 'seller_name': None,
 'title': 'Kia XCeed 1.5 TGDI Mild-Hybrid Tech',
 'transmission': 'automatic',
 'trim': 'Tech',
 'year': 2023}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW14097%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.es] INFO: Saving data for KW14097: {'auction_closing_time': 1774715282.0, 'created_time': 1773130900.801868, 'last_price_update_time': 1774696136.475009}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KW14097') HTTP/1.1" 204 0
2026-03-28 11:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: TE55978
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: DG64903
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG64903%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.es] INFO: Scrape type for DG64903: 2
2026-03-28 11:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903
2026-03-28 11:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23ebf95-31eb-5c82-8323-698822098da3 with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b23ebf95-31eb-5c82-8323-698822098da3 with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b23ebf95-31eb-5c82-8323-698822098da3, identifier: DG64903
2026-03-28 11:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903
2026-03-28 11:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903
2026-03-28 11:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903 to the API
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:39:47Z',
 'fuel_type': 'hybrid',
 'id': 'b23ebf95-31eb-5c82-8323-698822098da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG64903',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 8778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-25',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Trocadero',
 'transmission': 'automatic',
 'trim': 'Trocadero',
 'year': 2023}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG64903%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.es] INFO: Saving data for DG64903: {'auction_closing_time': 1774715987.0, 'created_time': 1773131099.859072, 'last_price_update_time': 1774696136.963687}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG64903') HTTP/1.1" 204 0
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: YE59618
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: FJ48335
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: YP50704
2026-03-28 11:08:56 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML86623%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.es] INFO: Scrape type for ML86623: 2
2026-03-28 11:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05 with identifier: ML86623
2026-03-28 11:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05 with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05 with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05, identifier: ML86623
2026-03-28 11:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05 with identifier: ML86623
2026-03-28 11:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05 with identifier: ML86623
2026-03-28 11:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05 with identifier: ML86623 to the API
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:25Z',
 'fuel_type': 'diesel',
 'id': '03c8fa0a-7ecb-5bf5-97e3-edfb994f0c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML86623',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 201201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-24',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML86623%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.es] INFO: Saving data for ML86623: {'auction_closing_time': 1774714885.0, 'created_time': 1774609542.89947, 'last_price_update_time': 1774696137.352557}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ML86623') HTTP/1.1" 204 0
2026-03-28 11:08:57 [auto1.es] INFO: Found listing with ID: AE33071
2026-03-28 11:08:57 [auto1.es] INFO: Found listing with ID: EY16008
2026-03-28 11:08:57 [auto1.es] INFO: Found listing with ID: WB62155
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB62155%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.es] INFO: Scrape type for WB62155: 2
2026-03-28 11:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155
2026-03-28 11:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a1f0488-e5d5-5c75-95dd-02d0938edf61, identifier: WB62155
2026-03-28 11:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 11:08:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155
2026-03-28 11:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155 to the API
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:10:49Z',
 'fuel_type': 'petrol',
 'id': '3a1f0488-e5d5-5c75-95dd-02d0938edf61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB62155',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 25429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-26',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2023}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB62155%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.es] INFO: Saving data for WB62155: {'auction_closing_time': 1774714249.0, 'created_time': 1773130259.619267, 'last_price_update_time': 1774696137.863567}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WB62155') HTTP/1.1" 204 0
2026-03-28 11:08:57 [auto1.es] INFO: Found listing with ID: XZ16571
2026-03-28 11:08:57 [auto1.es] INFO: Found listing with ID: BZ14545
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ14545%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.es] INFO: Scrape type for BZ14545: 2
2026-03-28 11:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545
2026-03-28 11:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2443bad3-e85d-51ce-bd94-b12fe801d728 with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2443bad3-e85d-51ce-bd94-b12fe801d728 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2443bad3-e85d-51ce-bd94-b12fe801d728, identifier: BZ14545
2026-03-28 11:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545
2026-03-28 11:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545
2026-03-28 11:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545 to the API
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:58:16Z',
 'fuel_type': 'diesel',
 'id': '2443bad3-e85d-51ce-bd94-b12fe801d728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ14545',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 65979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Contrlol M',
 'transmission': 'manual',
 'trim': 'Contrlol M',
 'year': 2021}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ14545%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.es] INFO: Saving data for BZ14545: {'auction_closing_time': 1774717096.0, 'created_time': 1773131300.478276, 'last_price_update_time': 1774696138.402765}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BZ14545') HTTP/1.1" 204 0
2026-03-28 11:08:58 [auto1.es] INFO: Found listing with ID: SP81388
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP81388%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.es] INFO: Scrape type for SP81388: 2
2026-03-28 11:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d09e745-b0d9-5009-90e4-68f37226c3c1 with identifier: SP81388
2026-03-28 11:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d09e745-b0d9-5009-90e4-68f37226c3c1 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d09e745-b0d9-5009-90e4-68f37226c3c1 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d09e745-b0d9-5009-90e4-68f37226c3c1, identifier: SP81388
2026-03-28 11:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d09e745-b0d9-5009-90e4-68f37226c3c1 with identifier: SP81388
2026-03-28 11:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d09e745-b0d9-5009-90e4-68f37226c3c1 with identifier: SP81388
2026-03-28 11:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3d09e745-b0d9-5009-90e4-68f37226c3c1 with identifier: SP81388 to the API
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:06Z',
 'fuel_type': 'diesel',
 'id': '3d09e745-b0d9-5009-90e4-68f37226c3c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP81388',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 12302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2022}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP81388%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.es] INFO: Saving data for SP81388: {'auction_closing_time': 1774716246.0, 'created_time': 1773131126.46909, 'last_price_update_time': 1774696138.945114}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SP81388') HTTP/1.1" 204 0
2026-03-28 11:08:58 [auto1.es] INFO: Found listing with ID: YL98507
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL98507%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.es] INFO: Scrape type for YL98507: 2
2026-03-28 11:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507
2026-03-28 11:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457, identifier: YL98507
2026-03-28 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507
2026-03-28 11:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507
2026-03-28 11:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507 to the API
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:47:25Z',
 'fuel_type': 'diesel',
 'id': 'b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL98507',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 29039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-23',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL98507%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.es] INFO: Saving data for YL98507: {'auction_closing_time': 1774716445.0, 'created_time': 1773131224.864423, 'last_price_update_time': 1774696139.376673}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YL98507') HTTP/1.1" 204 0
2026-03-28 11:08:59 [auto1.es] INFO: Found listing with ID: UZ13447
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ13447%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.es] INFO: Scrape type for UZ13447: 2
2026-03-28 11:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447
2026-03-28 11:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a7e453a-812e-53c3-a3ab-104a9941c974 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a7e453a-812e-53c3-a3ab-104a9941c974 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a7e453a-812e-53c3-a3ab-104a9941c974, identifier: UZ13447
2026-03-28 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447
2026-03-28 11:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447
2026-03-28 11:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447 to the API
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:30:19Z',
 'fuel_type': 'diesel',
 'id': '4a7e453a-812e-53c3-a3ab-104a9941c974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ13447',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 146729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2022}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ13447%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.es] INFO: Saving data for UZ13447: {'auction_closing_time': 1774715419.0, 'created_time': 1773127261.341247, 'last_price_update_time': 1774696139.836603}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ13447') HTTP/1.1" 204 0
2026-03-28 11:08:59 [auto1.es] INFO: Found listing with ID: KX02596
2026-03-28 11:08:59 [auto1.es] INFO: Found listing with ID: VC76613
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC76613%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.es] INFO: Scrape type for VC76613: 2
2026-03-28 11:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc137838-e048-5120-8f44-16dd6779f318 with identifier: VC76613
2026-03-28 11:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc137838-e048-5120-8f44-16dd6779f318 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc137838-e048-5120-8f44-16dd6779f318 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cc137838-e048-5120-8f44-16dd6779f318, identifier: VC76613
2026-03-28 11:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cc137838-e048-5120-8f44-16dd6779f318 with identifier: VC76613
2026-03-28 11:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cc137838-e048-5120-8f44-16dd6779f318 with identifier: VC76613
2026-03-28 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cc137838-e048-5120-8f44-16dd6779f318 with identifier: VC76613 to the API
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:09:52Z',
 'fuel_type': 'hybrid',
 'id': 'cc137838-e048-5120-8f44-16dd6779f318',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC76613',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 196345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-20',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2022}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC76613%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.es] INFO: Saving data for VC76613: {'auction_closing_time': 1774714192.0, 'created_time': 1773126791.504079, 'last_price_update_time': 1774696140.242643}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC76613') HTTP/1.1" 204 0
2026-03-28 11:09:00 [auto1.es] INFO: Found listing with ID: FE56951
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE56951%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.es] INFO: Scrape type for FE56951: 2
2026-03-28 11:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951
2026-03-28 11:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b55d219-11b3-55d1-8a23-fa27348d05f0 with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b55d219-11b3-55d1-8a23-fa27348d05f0 with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3b55d219-11b3-55d1-8a23-fa27348d05f0, identifier: FE56951
2026-03-28 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951
2026-03-28 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951
2026-03-28 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951 to the API
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:03Z',
 'fuel_type': 'petrol',
 'id': '3b55d219-11b3-55d1-8a23-fa27348d05f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE56951',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 39634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-07',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2021}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE56951%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.es] INFO: Saving data for FE56951: {'auction_closing_time': 1774715043.0, 'created_time': 1773131132.90541, 'last_price_update_time': 1774696140.663439}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FE56951') HTTP/1.1" 204 0
2026-03-28 11:09:00 [auto1.es] INFO: Found listing with ID: RD14633
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD14633%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.es] INFO: Scrape type for RD14633: 2
2026-03-28 11:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633
2026-03-28 11:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf, identifier: RD14633
2026-03-28 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633
2026-03-28 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633
2026-03-28 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633 to the API
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:07:39Z',
 'fuel_type': 'petrol',
 'id': '5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD14633',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 19440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD14633%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Saving data for RD14633: {'auction_closing_time': 1774714059.0, 'created_time': 1773131334.589563, 'last_price_update_time': 1774696141.059271}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD14633') HTTP/1.1" 204 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: GT51555
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: ZM80152
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: FN90345
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA28450%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for ZA28450: 2
2026-03-28 11:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f070bd-a52c-5cde-bf6a-8c12568b6234 with identifier: ZA28450
2026-03-28 11:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f070bd-a52c-5cde-bf6a-8c12568b6234 with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98f070bd-a52c-5cde-bf6a-8c12568b6234 with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98f070bd-a52c-5cde-bf6a-8c12568b6234, identifier: ZA28450
2026-03-28 11:09:01 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98f070bd-a52c-5cde-bf6a-8c12568b6234 with identifier: ZA28450
2026-03-28 11:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98f070bd-a52c-5cde-bf6a-8c12568b6234 with identifier: ZA28450
2026-03-28 11:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98f070bd-a52c-5cde-bf6a-8c12568b6234 with identifier: ZA28450 to the API
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:54:37Z',
 'fuel_type': 'diesel',
 'id': '98f070bd-a52c-5cde-bf6a-8c12568b6234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA28450',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 174698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-18',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2004}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA28450%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Saving data for ZA28450: {'auction_closing_time': 1774716877.0, 'created_time': 1773230942.78522, 'last_price_update_time': 1774696141.444316}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA28450') HTTP/1.1" 204 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV73300%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for VV73300: 2
2026-03-28 11:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300
2026-03-28 11:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d, identifier: VV73300
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: LT61588
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LT61588%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for LT61588: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: UL23725
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: YC43770
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: FZ62617
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ62617%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for FZ62617: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: UZ90227
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ90227%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for UZ90227: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT66486%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for CT66486: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: TN50205
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN50205%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for TN50205: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ32217%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for FJ32217: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: MU50158
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU50158%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for MU50158: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: LV83724
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: KH40259
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH40259%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for KH40259: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: EF00810
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF00810%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for EF00810: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: CR96058
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: NH80896
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ54433%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for JJ54433: 0
2026-03-28 11:09:01 [auto1.es] INFO: Found listing with ID: PX76519
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX76519%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.es] INFO: Scrape type for PX76519: 2
2026-03-28 11:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519
2026-03-28 11:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd, identifier: PX76519
2026-03-28 11:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300
2026-03-28 11:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300
2026-03-28 11:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300 to the API
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:39:15Z',
 'fuel_type': 'hybrid',
 'id': 'dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV73300',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'UX-Serie',
 'odometer': 76710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'Lexus UX-Serie UX 250h Eco',
 'transmission': 'automatic',
 'trim': 'Eco',
 'year': 2022}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV73300%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.es] INFO: Saving data for VV73300: {'auction_closing_time': 1774715955.0, 'created_time': 1773131176.980672, 'last_price_update_time': 1774696142.456168}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV73300') HTTP/1.1" 204 0
2026-03-28 11:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519
2026-03-28 11:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519
2026-03-28 11:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519 to the API
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:51:23Z',
 'fuel_type': 'petrol',
 'id': 'bdda3c2b-ce2c-55f4-998e-1c33fb266dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX76519',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 47031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-26',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2023}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX76519%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.es] INFO: Saving data for PX76519: {'auction_closing_time': 1774716683.0, 'created_time': 1773692013.142466, 'last_price_update_time': 1774696142.858142}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX76519') HTTP/1.1" 204 0
2026-03-28 11:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:02 [auto1.es] INFO: Found listing with ID: AT54546
2026-03-28 11:09:02 [auto1.es] INFO: Found listing with ID: PB23846
2026-03-28 11:09:02 [auto1.es] INFO: Found listing with ID: VN77018
2026-03-28 11:09:02 [auto1.es] INFO: Found listing with ID: WG01714
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG01714%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.es] INFO: Scrape type for WG01714: 2
2026-03-28 11:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714
2026-03-28 11:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b, identifier: WG01714
2026-03-28 11:09:02 [auto1.es] INFO: Found listing with ID: TJ03460
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ03460%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.es] INFO: Scrape type for TJ03460: 2
2026-03-28 11:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6 with identifier: TJ03460
2026-03-28 11:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6 with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6, identifier: TJ03460
2026-03-28 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714
2026-03-28 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714
2026-03-28 11:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714 to the API
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:01Z',
 'fuel_type': 'diesel',
 'id': 'db05ce6b-3781-5bf6-9f8d-7656c7f32a1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG01714',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 12472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine Pack',
 'transmission': 'manual',
 'trim': 'Shine Pack',
 'year': 2022}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG01714%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.es] INFO: Saving data for WG01714: {'auction_closing_time': 1774715581.0, 'created_time': 1773131258.764516, 'last_price_update_time': 1774696143.448147}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG01714') HTTP/1.1" 204 0
2026-03-28 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6 with identifier: TJ03460
2026-03-28 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6 with identifier: TJ03460
2026-03-28 11:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6 with identifier: TJ03460 to the API
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:08Z',
 'fuel_type': 'diesel',
 'id': 'e44a6f02-d473-5c7f-94e6-d2d60a1e4fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ03460',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 53839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ03460%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.es] INFO: Saving data for TJ03460: {'auction_closing_time': 1774715348.0, 'created_time': 1774383026.086827, 'last_price_update_time': 1774696143.715712}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ03460') HTTP/1.1" 204 0
2026-03-28 11:09:03 [auto1.es] INFO: Found listing with ID: TB50178
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB50178%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.es] INFO: Scrape type for TB50178: 2
2026-03-28 11:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1691bb2-27bc-5678-b2a1-2138c013113f with identifier: TB50178
2026-03-28 11:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1691bb2-27bc-5678-b2a1-2138c013113f with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1691bb2-27bc-5678-b2a1-2138c013113f with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1691bb2-27bc-5678-b2a1-2138c013113f, identifier: TB50178
2026-03-28 11:09:03 [auto1.es] INFO: Found listing with ID: EE78385
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE78385%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.es] INFO: Scrape type for EE78385: 2
2026-03-28 11:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73030f6a-129e-5583-af4b-0a48151cbcc5 with identifier: EE78385
2026-03-28 11:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73030f6a-129e-5583-af4b-0a48151cbcc5 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73030f6a-129e-5583-af4b-0a48151cbcc5 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73030f6a-129e-5583-af4b-0a48151cbcc5, identifier: EE78385
2026-03-28 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1691bb2-27bc-5678-b2a1-2138c013113f with identifier: TB50178
2026-03-28 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1691bb2-27bc-5678-b2a1-2138c013113f with identifier: TB50178
2026-03-28 11:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a1691bb2-27bc-5678-b2a1-2138c013113f with identifier: TB50178 to the API
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:28Z',
 'fuel_type': 'diesel',
 'id': 'a1691bb2-27bc-5678-b2a1-2138c013113f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB50178',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 267671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2006}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB50178%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.es] INFO: Saving data for TB50178: {'auction_closing_time': 1774715368.0, 'created_time': 1774609556.062542, 'last_price_update_time': 1774696144.190807}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB50178') HTTP/1.1" 204 0
2026-03-28 11:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73030f6a-129e-5583-af4b-0a48151cbcc5 with identifier: EE78385
2026-03-28 11:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73030f6a-129e-5583-af4b-0a48151cbcc5 with identifier: EE78385
2026-03-28 11:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73030f6a-129e-5583-af4b-0a48151cbcc5 with identifier: EE78385 to the API
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:54:48Z',
 'fuel_type': 'petrol',
 'id': '73030f6a-129e-5583-af4b-0a48151cbcc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE78385',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 90705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2021}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE78385%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.es] INFO: Saving data for EE78385: {'auction_closing_time': 1774716888.0, 'created_time': 1774609561.982775, 'last_price_update_time': 1774696144.446823}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EE78385') HTTP/1.1" 204 0
2026-03-28 11:09:04 [auto1.es] INFO: Found listing with ID: JK29035
2026-03-28 11:09:04 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL72913%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.es] INFO: Scrape type for VL72913: 0
2026-03-28 11:09:04 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-28 11:09:04 [auto1.es] INFO: Found listing with ID: XP57901
2026-03-28 11:09:04 [auto1.es] INFO: Found listing with ID: JW76352
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW76352%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.es] INFO: Scrape type for JW76352: 2
2026-03-28 11:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc51a07-18c3-57ec-95a4-ef55e3dd4e7e with identifier: JW76352
2026-03-28 11:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc51a07-18c3-57ec-95a4-ef55e3dd4e7e with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afc51a07-18c3-57ec-95a4-ef55e3dd4e7e with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: afc51a07-18c3-57ec-95a4-ef55e3dd4e7e, identifier: JW76352
2026-03-28 11:09:04 [auto1.es] INFO: Found listing with ID: RL54744
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL54744%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.es] INFO: Scrape type for RL54744: 2
2026-03-28 11:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83 with identifier: RL54744
2026-03-28 11:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83 with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83 with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83, identifier: RL54744
2026-03-28 11:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: afc51a07-18c3-57ec-95a4-ef55e3dd4e7e with identifier: JW76352
2026-03-28 11:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: afc51a07-18c3-57ec-95a4-ef55e3dd4e7e with identifier: JW76352
2026-03-28 11:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: afc51a07-18c3-57ec-95a4-ef55e3dd4e7e with identifier: JW76352 to the API
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:48:23Z',
 'fuel_type': 'diesel',
 'id': 'afc51a07-18c3-57ec-95a4-ef55e3dd4e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW76352',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 29890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-17',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Edition BlueMotion',
 'year': 2014}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW76352%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.es] INFO: Saving data for JW76352: {'auction_closing_time': 1774716503.0, 'created_time': 1774609563.028489, 'last_price_update_time': 1774696144.945026}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW76352') HTTP/1.1" 204 0
2026-03-28 11:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83 with identifier: RL54744
2026-03-28 11:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83 with identifier: RL54744
2026-03-28 11:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2bb7e77-0301-5fc4-8d9d-5c05c5a40e83 with identifier: RL54744 to the API
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:44Z',
 'fuel_type': 'diesel',
 'id': 'd2bb7e77-0301-5fc4-8d9d-5c05c5a40e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL54744',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 262569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL54744%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.es] INFO: Saving data for RL54744: {'auction_closing_time': 1774714664.0, 'created_time': 1774609558.581293, 'last_price_update_time': 1774696145.307113}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RL54744') HTTP/1.1" 204 0
2026-03-28 11:09:05 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11386%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.es] INFO: Scrape type for AB11386: 2
2026-03-28 11:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386
2026-03-28 11:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 157e31d6-70f0-5f94-bf32-5110ee75fb13 with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 157e31d6-70f0-5f94-bf32-5110ee75fb13 with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 157e31d6-70f0-5f94-bf32-5110ee75fb13, identifier: AB11386
2026-03-28 11:09:05 [auto1.es] INFO: Found listing with ID: FL97062
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL97062%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.es] INFO: Scrape type for FL97062: 2
2026-03-28 11:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd3656a-2361-58a4-b704-8d5da28ebd5a with identifier: FL97062
2026-03-28 11:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd3656a-2361-58a4-b704-8d5da28ebd5a with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bd3656a-2361-58a4-b704-8d5da28ebd5a with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6bd3656a-2361-58a4-b704-8d5da28ebd5a, identifier: FL97062
2026-03-28 11:09:05 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 26 pages/min), scraped 118 items (at 39 items/min)
2026-03-28 11:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-28 11:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386
2026-03-28 11:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386
2026-03-28 11:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386 to the API
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:50Z',
 'fuel_type': 'petrol',
 'id': '157e31d6-70f0-5f94-bf32-5110ee75fb13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB11386',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 56655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2023}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11386%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.es] INFO: Saving data for AB11386: {'auction_closing_time': 1774716710.0, 'created_time': 1773918553.357522, 'last_price_update_time': 1774696145.813931}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AB11386') HTTP/1.1" 204 0
2026-03-28 11:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6bd3656a-2361-58a4-b704-8d5da28ebd5a with identifier: FL97062
2026-03-28 11:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6bd3656a-2361-58a4-b704-8d5da28ebd5a with identifier: FL97062
2026-03-28 11:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6bd3656a-2361-58a4-b704-8d5da28ebd5a with identifier: FL97062 to the API
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 398,
 'expiration_date': '2026-03-28T16:35:51Z',
 'fuel_type': 'hybrid',
 'id': '6bd3656a-2361-58a4-b704-8d5da28ebd5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL97062',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 48879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Recharge Plug-in Hybrid Plus Dark AWD',
 'transmission': 'automatic',
 'trim': 'Plus Dark AWD',
 'year': 2023}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL97062%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Saving data for FL97062: {'auction_closing_time': 1774715751.0, 'created_time': 1774383045.613325, 'last_price_update_time': 1774696146.082079}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FL97062') HTTP/1.1" 204 0
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: XR29035
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR29035%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Scrape type for XR29035: 0
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: YF06119
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF06119%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Scrape type for YF06119: 0
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: MC71487
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC71487%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Scrape type for MC71487: 0
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: PC36576
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: TG55276
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG55276%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Scrape type for TG55276: 2
2026-03-28 11:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276
2026-03-28 11:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cc8932-01b7-5bbe-bdad-7e177f727479 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50cc8932-01b7-5bbe-bdad-7e177f727479 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50cc8932-01b7-5bbe-bdad-7e177f727479, identifier: TG55276
2026-03-28 11:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276
2026-03-28 11:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276
2026-03-28 11:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276 to the API
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:20:44Z',
 'fuel_type': 'diesel',
 'id': '50cc8932-01b7-5bbe-bdad-7e177f727479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG55276',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 199347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seller_name': None,
 'title': 'Audi Q2 30 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG55276%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Saving data for TG55276: {'auction_closing_time': 1774714844.0, 'created_time': 1773692083.48865, 'last_price_update_time': 1774696146.517287}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG55276') HTTP/1.1" 204 0
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: VL76370
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL76370%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Scrape type for VL76370: 2
2026-03-28 11:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b10b26-c863-5704-82c6-83f7f7fba646 with identifier: VL76370
2026-03-28 11:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b10b26-c863-5704-82c6-83f7f7fba646 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24b10b26-c863-5704-82c6-83f7f7fba646 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24b10b26-c863-5704-82c6-83f7f7fba646, identifier: VL76370
2026-03-28 11:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24b10b26-c863-5704-82c6-83f7f7fba646 with identifier: VL76370
2026-03-28 11:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24b10b26-c863-5704-82c6-83f7f7fba646 with identifier: VL76370
2026-03-28 11:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24b10b26-c863-5704-82c6-83f7f7fba646 with identifier: VL76370 to the API
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:36:51Z',
 'fuel_type': 'diesel',
 'id': '24b10b26-c863-5704-82c6-83f7f7fba646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL76370',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 165592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2022}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL76370%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Saving data for VL76370: {'auction_closing_time': 1774715811.0, 'created_time': 1774361484.381847, 'last_price_update_time': 1774696146.919531}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL76370') HTTP/1.1" 204 0
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-28 11:09:06 [auto1.es] INFO: Found listing with ID: HL96316
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL96316%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.es] INFO: Scrape type for HL96316: 2
2026-03-28 11:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702ab785-82e6-5916-8c52-e6b15601ffb6 with identifier: HL96316
2026-03-28 11:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702ab785-82e6-5916-8c52-e6b15601ffb6 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 702ab785-82e6-5916-8c52-e6b15601ffb6 with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 702ab785-82e6-5916-8c52-e6b15601ffb6, identifier: HL96316
2026-03-28 11:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 702ab785-82e6-5916-8c52-e6b15601ffb6 with identifier: HL96316
2026-03-28 11:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 702ab785-82e6-5916-8c52-e6b15601ffb6 with identifier: HL96316
2026-03-28 11:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 702ab785-82e6-5916-8c52-e6b15601ffb6 with identifier: HL96316 to the API
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '702ab785-82e6-5916-8c52-e6b15601ffb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL96316',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 110077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2021}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL96316%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.es] INFO: Saving data for HL96316: {'auction_closing_time': 1774714551.0, 'created_time': 1773692069.150672, 'last_price_update_time': 1774696147.336137}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL96316') HTTP/1.1" 204 0
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: NA14080
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: KD32086
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: JE90684
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: KL07706
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: ZC57359
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: LJ23140
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ23140%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.es] INFO: Scrape type for LJ23140: 2
2026-03-28 11:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140
2026-03-28 11:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c62eb9-b82e-5727-bb0b-285648d901f6 with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c62eb9-b82e-5727-bb0b-285648d901f6 with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 82c62eb9-b82e-5727-bb0b-285648d901f6, identifier: LJ23140
2026-03-28 11:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140
2026-03-28 11:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140
2026-03-28 11:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140 to the API
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:05:11Z',
 'fuel_type': 'hybrid',
 'id': '82c62eb9-b82e-5727-bb0b-285648d901f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ23140',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'UX-Serie',
 'odometer': 32574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'Lexus UX-Serie UX 250h Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2022}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ23140%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.es] INFO: Saving data for LJ23140: {'auction_closing_time': 1774713911.0, 'created_time': 1773238732.442595, 'last_price_update_time': 1774696147.829007}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ23140') HTTP/1.1" 204 0
2026-03-28 11:09:07 [auto1.es] INFO: Found listing with ID: CH50110
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.es] INFO: Scrape type for CH50110: 2
2026-03-28 11:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2026-03-28 11:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cb1834-e1ac-5552-96c3-6d17f8986e21 with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35cb1834-e1ac-5552-96c3-6d17f8986e21 with scrape type 2
2026-03-28 11:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35cb1834-e1ac-5552-96c3-6d17f8986e21, identifier: CH50110
2026-03-28 11:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2026-03-28 11:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2026-03-28 11:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110 to the API
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:30:54Z',
 'fuel_type': 'diesel',
 'id': '35cb1834-e1ac-5552-96c3-6d17f8986e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH50110',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 193064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2026-03-28 11:09:08 [auto1.es] INFO: Saving data for CH50110: {'auction_closing_time': 1774715454.0, 'created_time': 1773692064.66412, 'last_price_update_time': 1774696148.343921}
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH50110') HTTP/1.1" 204 0
2026-03-28 11:09:08 [auto1.es] INFO: Found listing with ID: ET64130
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET64130%27 HTTP/1.1" 200 None
2026-03-28 11:09:08 [auto1.es] INFO: Scrape type for ET64130: 2
2026-03-28 11:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130
2026-03-28 11:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4573372c-75b1-55af-8c01-7edc3a0756e1 with scrape type 2
2026-03-28 11:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4573372c-75b1-55af-8c01-7edc3a0756e1 with scrape type 2
2026-03-28 11:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4573372c-75b1-55af-8c01-7edc3a0756e1, identifier: ET64130
2026-03-28 11:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130
2026-03-28 11:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130
2026-03-28 11:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130 to the API
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:36:40Z',
 'fuel_type': 'petrol',
 'id': '4573372c-75b1-55af-8c01-7edc3a0756e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET64130',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 28773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-05',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2024}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET64130%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.es] INFO: Saving data for ET64130: {'auction_closing_time': 1774715800.0, 'created_time': 1773131373.845968, 'last_price_update_time': 1774696149.551319}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET64130') HTTP/1.1" 204 0
2026-03-28 11:09:09 [auto1.es] INFO: Found listing with ID: WL07406
2026-03-28 11:09:09 [auto1.es] INFO: Found listing with ID: JL80339
2026-03-28 11:09:09 [auto1.es] INFO: Found listing with ID: UP46325
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP46325%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.es] INFO: Scrape type for UP46325: 2
2026-03-28 11:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 781111f8-21dc-5cfe-87b4-b9b4054383ce with identifier: UP46325
2026-03-28 11:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 781111f8-21dc-5cfe-87b4-b9b4054383ce with scrape type 2
2026-03-28 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 781111f8-21dc-5cfe-87b4-b9b4054383ce with scrape type 2
2026-03-28 11:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 781111f8-21dc-5cfe-87b4-b9b4054383ce, identifier: UP46325
2026-03-28 11:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 781111f8-21dc-5cfe-87b4-b9b4054383ce with identifier: UP46325
2026-03-28 11:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 781111f8-21dc-5cfe-87b4-b9b4054383ce with identifier: UP46325
2026-03-28 11:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 781111f8-21dc-5cfe-87b4-b9b4054383ce with identifier: UP46325 to the API
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:21:51Z',
 'fuel_type': 'hybrid',
 'id': '781111f8-21dc-5cfe-87b4-b9b4054383ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP46325',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 131684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP46325%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.es] INFO: Saving data for UP46325: {'auction_closing_time': 1774714911.0, 'created_time': 1774382789.985005, 'last_price_update_time': 1774696149.909929}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP46325') HTTP/1.1" 204 0
2026-03-28 11:09:09 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM77073%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.es] INFO: Scrape type for MM77073: 2
2026-03-28 11:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073
2026-03-28 11:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with scrape type 2
2026-03-28 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7900c92-8e92-52d2-ac56-8fcc778ef6a4, identifier: MM77073
2026-03-28 11:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073
2026-03-28 11:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073
2026-03-28 11:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073 to the API
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:43:56Z',
 'fuel_type': 'diesel',
 'id': 'c7900c92-8e92-52d2-ac56-8fcc778ef6a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM77073',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 115434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM77073%27 HTTP/1.1" 200 None
2026-03-28 11:09:10 [auto1.es] INFO: Saving data for MM77073: {'auction_closing_time': 1774716236.0, 'created_time': 1774037423.173721, 'last_price_update_time': 1774696150.295098}
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MM77073') HTTP/1.1" 204 0
2026-03-28 11:09:10 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:10 [auto1.es] INFO: Found listing with ID: DV58619
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV58619%27 HTTP/1.1" 200 None
2026-03-28 11:09:10 [auto1.es] INFO: Scrape type for DV58619: 2
2026-03-28 11:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8371ed-58fe-575f-87d4-00a257dc3a45 with identifier: DV58619
2026-03-28 11:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8371ed-58fe-575f-87d4-00a257dc3a45 with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8371ed-58fe-575f-87d4-00a257dc3a45 with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf8371ed-58fe-575f-87d4-00a257dc3a45, identifier: DV58619
2026-03-28 11:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf8371ed-58fe-575f-87d4-00a257dc3a45 with identifier: DV58619
2026-03-28 11:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf8371ed-58fe-575f-87d4-00a257dc3a45 with identifier: DV58619
2026-03-28 11:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf8371ed-58fe-575f-87d4-00a257dc3a45 with identifier: DV58619 to the API
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:49:13Z',
 'fuel_type': 'hybrid',
 'id': 'bf8371ed-58fe-575f-87d4-00a257dc3a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV58619',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 106792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV58619%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.es] INFO: Saving data for DV58619: {'auction_closing_time': 1774716553.0, 'created_time': 1774382782.266437, 'last_price_update_time': 1774696151.049633}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV58619') HTTP/1.1" 204 0
2026-03-28 11:09:11 [auto1.es] INFO: Found listing with ID: KE17366
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE17366%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.es] INFO: Scrape type for KE17366: 2
2026-03-28 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe2d5a63-1811-5da5-a7b5-3e158a4e0d80 with identifier: KE17366
2026-03-28 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe2d5a63-1811-5da5-a7b5-3e158a4e0d80 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe2d5a63-1811-5da5-a7b5-3e158a4e0d80 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe2d5a63-1811-5da5-a7b5-3e158a4e0d80, identifier: KE17366
2026-03-28 11:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:11 [auto1.es] INFO: Found listing with ID: MH58773
2026-03-28 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe2d5a63-1811-5da5-a7b5-3e158a4e0d80 with identifier: KE17366
2026-03-28 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe2d5a63-1811-5da5-a7b5-3e158a4e0d80 with identifier: KE17366
2026-03-28 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe2d5a63-1811-5da5-a7b5-3e158a4e0d80 with identifier: KE17366 to the API
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-28T16:20:13Z',
 'fuel_type': 'diesel',
 'id': 'fe2d5a63-1811-5da5-a7b5-3e158a4e0d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE17366',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 129739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-15',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE17366%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.es] INFO: Saving data for KE17366: {'auction_closing_time': 1774714813.0, 'created_time': 1774350416.920607, 'last_price_update_time': 1774696151.446768}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE17366') HTTP/1.1" 204 0
2026-03-28 11:09:11 [auto1.es] INFO: Found listing with ID: WM54096
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM54096%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.es] INFO: Scrape type for WM54096: 2
2026-03-28 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78fc6f8a-440c-53da-b39f-2d11fc3300f7 with identifier: WM54096
2026-03-28 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fc6f8a-440c-53da-b39f-2d11fc3300f7 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78fc6f8a-440c-53da-b39f-2d11fc3300f7 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78fc6f8a-440c-53da-b39f-2d11fc3300f7, identifier: WM54096
2026-03-28 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78fc6f8a-440c-53da-b39f-2d11fc3300f7 with identifier: WM54096
2026-03-28 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78fc6f8a-440c-53da-b39f-2d11fc3300f7 with identifier: WM54096
2026-03-28 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78fc6f8a-440c-53da-b39f-2d11fc3300f7 with identifier: WM54096 to the API
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:59:49Z',
 'fuel_type': 'petrol',
 'id': '78fc6f8a-440c-53da-b39f-2d11fc3300f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM54096',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 16668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-25',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.2 PureTech Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM54096%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.es] INFO: Saving data for WM54096: {'auction_closing_time': 1774717189.0, 'created_time': 1774609592.871105, 'last_price_update_time': 1774696151.811716}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WM54096') HTTP/1.1" 204 0
2026-03-28 11:09:11 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX68233%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.es] INFO: Scrape type for YX68233: 2
2026-03-28 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233
2026-03-28 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9, identifier: YX68233
2026-03-28 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233
2026-03-28 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233
2026-03-28 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233 to the API
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:01:45Z',
 'fuel_type': 'diesel',
 'id': '01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX68233',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 222592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX68233%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.es] INFO: Saving data for YX68233: {'auction_closing_time': 1774713705.0, 'created_time': 1773929157.204706, 'last_price_update_time': 1774696152.200787}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YX68233') HTTP/1.1" 204 0
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: FW39837
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: ES82633
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: JW31558
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: XW86216
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: ZR14615
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: MG74318
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB56604%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.es] INFO: Scrape type for EB56604: 2
2026-03-28 11:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed0422e-af9b-5d93-a6b0-fbd649dbc6d8 with identifier: EB56604
2026-03-28 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed0422e-af9b-5d93-a6b0-fbd649dbc6d8 with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed0422e-af9b-5d93-a6b0-fbd649dbc6d8 with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fed0422e-af9b-5d93-a6b0-fbd649dbc6d8, identifier: EB56604
2026-03-28 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fed0422e-af9b-5d93-a6b0-fbd649dbc6d8 with identifier: EB56604
2026-03-28 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fed0422e-af9b-5d93-a6b0-fbd649dbc6d8 with identifier: EB56604
2026-03-28 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fed0422e-af9b-5d93-a6b0-fbd649dbc6d8 with identifier: EB56604 to the API
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:33:38Z',
 'fuel_type': 'petrol',
 'id': 'fed0422e-af9b-5d93-a6b0-fbd649dbc6d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB56604',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 293110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB56604%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.es] INFO: Saving data for EB56604: {'auction_closing_time': 1774715618.0, 'created_time': 1773144259.666931, 'last_price_update_time': 1774696152.664106}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB56604') HTTP/1.1" 204 0
2026-03-28 11:09:12 [auto1.es] INFO: Found listing with ID: EZ75681
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ75681%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.es] INFO: Scrape type for EZ75681: 2
2026-03-28 11:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba with identifier: EZ75681
2026-03-28 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba, identifier: EZ75681
2026-03-28 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba with identifier: EZ75681
2026-03-28 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba with identifier: EZ75681
2026-03-28 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba with identifier: EZ75681 to the API
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:44:37Z',
 'fuel_type': 'petrol',
 'id': 'fd3f4cf9-1b77-58de-9d1c-cf99e1d0f9ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ75681',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 193270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-29',
 'seller_name': None,
 'title': 'Honda Civic 1.5 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 1998}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ75681%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.es] INFO: Saving data for EZ75681: {'auction_closing_time': 1774716277.0, 'created_time': 1774609589.710262, 'last_price_update_time': 1774696153.04445}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EZ75681') HTTP/1.1" 204 0
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: YP54060
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: FD92977
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: FJ63213
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM46867%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.es] INFO: Scrape type for YM46867: 2
2026-03-28 11:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d188cf-b358-510d-8090-27e553ae45b4 with identifier: YM46867
2026-03-28 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d188cf-b358-510d-8090-27e553ae45b4 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d188cf-b358-510d-8090-27e553ae45b4 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2d188cf-b358-510d-8090-27e553ae45b4, identifier: YM46867
2026-03-28 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2d188cf-b358-510d-8090-27e553ae45b4 with identifier: YM46867
2026-03-28 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2d188cf-b358-510d-8090-27e553ae45b4 with identifier: YM46867
2026-03-28 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2d188cf-b358-510d-8090-27e553ae45b4 with identifier: YM46867 to the API
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:43:35Z',
 'fuel_type': 'diesel',
 'id': 'f2d188cf-b358-510d-8090-27e553ae45b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM46867',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 274495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 270 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2001}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM46867%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.es] INFO: Saving data for YM46867: {'auction_closing_time': 1774716215.0, 'created_time': 1774609564.293122, 'last_price_update_time': 1774696153.42594}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YM46867') HTTP/1.1" 204 0
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: DM27699
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: FP35669
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: JE09459
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: XE32619
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE32619%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.es] INFO: Scrape type for XE32619: 2
2026-03-28 11:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f1abde0-1591-5317-a315-071c24b7448b with identifier: XE32619
2026-03-28 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1abde0-1591-5317-a315-071c24b7448b with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f1abde0-1591-5317-a315-071c24b7448b with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f1abde0-1591-5317-a315-071c24b7448b, identifier: XE32619
2026-03-28 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f1abde0-1591-5317-a315-071c24b7448b with identifier: XE32619
2026-03-28 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f1abde0-1591-5317-a315-071c24b7448b with identifier: XE32619
2026-03-28 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f1abde0-1591-5317-a315-071c24b7448b with identifier: XE32619 to the API
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:55:33Z',
 'fuel_type': 'diesel',
 'id': '1f1abde0-1591-5317-a315-071c24b7448b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE32619',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 192983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE32619%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.es] INFO: Saving data for XE32619: {'auction_closing_time': 1774716933.0, 'created_time': 1774609593.277052, 'last_price_update_time': 1774696153.881965}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XE32619') HTTP/1.1" 204 0
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: ZY33695
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: XC39222
2026-03-28 11:09:13 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH28057%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.es] INFO: Scrape type for DH28057: 2
2026-03-28 11:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96319a3b-853a-58ba-b05d-b0e3b255bb2c with identifier: DH28057
2026-03-28 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96319a3b-853a-58ba-b05d-b0e3b255bb2c with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96319a3b-853a-58ba-b05d-b0e3b255bb2c with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96319a3b-853a-58ba-b05d-b0e3b255bb2c, identifier: DH28057
2026-03-28 11:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96319a3b-853a-58ba-b05d-b0e3b255bb2c with identifier: DH28057
2026-03-28 11:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96319a3b-853a-58ba-b05d-b0e3b255bb2c with identifier: DH28057
2026-03-28 11:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 96319a3b-853a-58ba-b05d-b0e3b255bb2c with identifier: DH28057 to the API
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:37:55Z',
 'fuel_type': 'hybrid',
 'id': '96319a3b-853a-58ba-b05d-b0e3b255bb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH28057',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 301957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seller_name': None,
 'title': 'Renault Megane 1.6 E-Tech Hybrid Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH28057%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.es] INFO: Saving data for DH28057: {'auction_closing_time': 1774715875.0, 'created_time': 1773410771.829969, 'last_price_update_time': 1774696154.268377}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH28057') HTTP/1.1" 204 0
2026-03-28 11:09:14 [auto1.es] INFO: Found listing with ID: LC81120
2026-03-28 11:09:14 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD98283%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.es] INFO: Scrape type for GD98283: 2
2026-03-28 11:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56defa43-a310-589e-97b5-35e3385175d8 with identifier: GD98283
2026-03-28 11:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56defa43-a310-589e-97b5-35e3385175d8 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56defa43-a310-589e-97b5-35e3385175d8 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 56defa43-a310-589e-97b5-35e3385175d8, identifier: GD98283
2026-03-28 11:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 56defa43-a310-589e-97b5-35e3385175d8 with identifier: GD98283
2026-03-28 11:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 56defa43-a310-589e-97b5-35e3385175d8 with identifier: GD98283
2026-03-28 11:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 56defa43-a310-589e-97b5-35e3385175d8 with identifier: GD98283 to the API
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:23:37Z',
 'fuel_type': 'hybrid',
 'id': '56defa43-a310-589e-97b5-35e3385175d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD98283',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 363578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seller_name': None,
 'title': 'Renault Megane 1.6 E-Tech Hybrid Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD98283%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.es] INFO: Saving data for GD98283: {'auction_closing_time': 1774715017.0, 'created_time': 1773145552.274536, 'last_price_update_time': 1774696154.652399}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GD98283') HTTP/1.1" 204 0
2026-03-28 11:09:14 [auto1.es] INFO: Found listing with ID: CB57175
2026-03-28 11:09:14 [auto1.es] INFO: Found listing with ID: PZ72634
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ72634%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.es] INFO: Scrape type for PZ72634: 2
2026-03-28 11:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ee0a9c7-820c-5add-8dba-717f04de6d66 with identifier: PZ72634
2026-03-28 11:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ee0a9c7-820c-5add-8dba-717f04de6d66 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ee0a9c7-820c-5add-8dba-717f04de6d66 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ee0a9c7-820c-5add-8dba-717f04de6d66, identifier: PZ72634
2026-03-28 11:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ee0a9c7-820c-5add-8dba-717f04de6d66 with identifier: PZ72634
2026-03-28 11:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ee0a9c7-820c-5add-8dba-717f04de6d66 with identifier: PZ72634
2026-03-28 11:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ee0a9c7-820c-5add-8dba-717f04de6d66 with identifier: PZ72634 to the API
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:57:04Z',
 'fuel_type': 'petrol',
 'id': '9ee0a9c7-820c-5add-8dba-717f04de6d66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ72634',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 85675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-27',
 'seller_name': None,
 'title': 'Ford Focus 2.5 ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2006}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ72634%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.es] INFO: Saving data for PZ72634: {'auction_closing_time': 1774717024.0, 'created_time': 1774609591.42298, 'last_price_update_time': 1774696155.029839}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ72634') HTTP/1.1" 204 0
2026-03-28 11:09:15 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:15 [auto1.es] INFO: Found listing with ID: MS49436
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS49436%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.es] INFO: Scrape type for MS49436: 2
2026-03-28 11:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40d019a-fa17-5873-9331-bf0ce5df3af9 with identifier: MS49436
2026-03-28 11:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40d019a-fa17-5873-9331-bf0ce5df3af9 with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40d019a-fa17-5873-9331-bf0ce5df3af9 with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d40d019a-fa17-5873-9331-bf0ce5df3af9, identifier: MS49436
2026-03-28 11:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d40d019a-fa17-5873-9331-bf0ce5df3af9 with identifier: MS49436
2026-03-28 11:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d40d019a-fa17-5873-9331-bf0ce5df3af9 with identifier: MS49436
2026-03-28 11:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d40d019a-fa17-5873-9331-bf0ce5df3af9 with identifier: MS49436 to the API
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'diesel',
 'id': 'd40d019a-fa17-5873-9331-bf0ce5df3af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS49436',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 320124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS49436%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.es] INFO: Saving data for MS49436: {'auction_closing_time': 1774716936.0, 'created_time': 1774609575.001864, 'last_price_update_time': 1774696155.494538}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS49436') HTTP/1.1" 204 0
2026-03-28 11:09:15 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE41555%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.es] INFO: Scrape type for ZE41555: 2
2026-03-28 11:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555
2026-03-28 11:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c6fd423-065b-543b-aa3e-b5687f36610b with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c6fd423-065b-543b-aa3e-b5687f36610b with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c6fd423-065b-543b-aa3e-b5687f36610b, identifier: ZE41555
2026-03-28 11:09:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:15 [auto1.es] INFO: Found listing with ID: RR62391
2026-03-28 11:09:15 [auto1.es] INFO: Found listing with ID: AJ84089
2026-03-28 11:09:15 [auto1.es] INFO: Found listing with ID: FB43319
2026-03-28 11:09:15 [auto1.es] INFO: Found listing with ID: XC46914
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC46914%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.es] INFO: Scrape type for XC46914: 2
2026-03-28 11:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af909df-8d0f-5de6-9318-c80d57ea2a60 with identifier: XC46914
2026-03-28 11:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af909df-8d0f-5de6-9318-c80d57ea2a60 with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af909df-8d0f-5de6-9318-c80d57ea2a60 with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6af909df-8d0f-5de6-9318-c80d57ea2a60, identifier: XC46914
2026-03-28 11:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555
2026-03-28 11:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555
2026-03-28 11:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555 to the API
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:55:35Z',
 'fuel_type': 'diesel',
 'id': '8c6fd423-065b-543b-aa3e-b5687f36610b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE41555',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '807',
 'odometer': 198886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-20',
 'seller_name': None,
 'title': 'Peugeot 807 2.0 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2008}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE41555%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.es] INFO: Saving data for ZE41555: {'auction_closing_time': 1774716935.0, 'created_time': 1774001896.854863, 'last_price_update_time': 1774696155.996411}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE41555') HTTP/1.1" 204 0
2026-03-28 11:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6af909df-8d0f-5de6-9318-c80d57ea2a60 with identifier: XC46914
2026-03-28 11:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6af909df-8d0f-5de6-9318-c80d57ea2a60 with identifier: XC46914
2026-03-28 11:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6af909df-8d0f-5de6-9318-c80d57ea2a60 with identifier: XC46914 to the API
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:00:31Z',
 'fuel_type': 'diesel',
 'id': '6af909df-8d0f-5de6-9318-c80d57ea2a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC46914',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 106983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC46914%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.es] INFO: Saving data for XC46914: {'auction_closing_time': 1774713631.0, 'created_time': 1774609586.758537, 'last_price_update_time': 1774696156.252317}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC46914') HTTP/1.1" 204 0
2026-03-28 11:09:16 [auto1.es] INFO: Found listing with ID: HM27570
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM27570%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.es] INFO: Scrape type for HM27570: 2
2026-03-28 11:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570
2026-03-28 11:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2fecbf-1e45-5902-802a-6e1e31f69641 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2fecbf-1e45-5902-802a-6e1e31f69641 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f2fecbf-1e45-5902-802a-6e1e31f69641, identifier: HM27570
2026-03-28 11:09:16 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-28 11:09:16 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-28 11:09:16 [auto1.es] INFO: Found listing with ID: TD25649
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD25649%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.es] INFO: Scrape type for TD25649: 2
2026-03-28 11:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44a3e134-b63e-58a7-95fe-d33aa3032ec3 with identifier: TD25649
2026-03-28 11:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44a3e134-b63e-58a7-95fe-d33aa3032ec3 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44a3e134-b63e-58a7-95fe-d33aa3032ec3 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44a3e134-b63e-58a7-95fe-d33aa3032ec3, identifier: TD25649
2026-03-28 11:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570
2026-03-28 11:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570
2026-03-28 11:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570 to the API
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-28T16:18:18Z',
 'fuel_type': 'petrol',
 'id': '2f2fecbf-1e45-5902-802a-6e1e31f69641',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM27570',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 19352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-19',
 'seller_name': None,
 'title': 'Hyundai Bayon 1.2 Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2024}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM27570%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.es] INFO: Saving data for HM27570: {'auction_closing_time': 1774714698.0, 'created_time': 1774275038.468778, 'last_price_update_time': 1774696156.758493}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HM27570') HTTP/1.1" 204 0
2026-03-28 11:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44a3e134-b63e-58a7-95fe-d33aa3032ec3 with identifier: TD25649
2026-03-28 11:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44a3e134-b63e-58a7-95fe-d33aa3032ec3 with identifier: TD25649
2026-03-28 11:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 44a3e134-b63e-58a7-95fe-d33aa3032ec3 with identifier: TD25649 to the API
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:03:32Z',
 'fuel_type': 'diesel',
 'id': '44a3e134-b63e-58a7-95fe-d33aa3032ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD25649',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 134295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2018}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD25649%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Saving data for TD25649: {'auction_closing_time': 1774713812.0, 'created_time': 1774609592.010462, 'last_price_update_time': 1774696157.023112}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TD25649') HTTP/1.1" 204 0
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: AL28647
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: PC53610
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC53610%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Scrape type for PC53610: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe41a9f-043f-563b-bb4c-b8dddff86f96 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efe41a9f-043f-563b-bb4c-b8dddff86f96 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efe41a9f-043f-563b-bb4c-b8dddff86f96, identifier: PC53610
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: AS51467
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS51467%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Scrape type for AS51467: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c443ae57-5917-503b-9a28-3bc7a3a4f850 with identifier: AS51467
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c443ae57-5917-503b-9a28-3bc7a3a4f850 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c443ae57-5917-503b-9a28-3bc7a3a4f850 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c443ae57-5917-503b-9a28-3bc7a3a4f850, identifier: AS51467
2026-03-28 11:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610
2026-03-28 11:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610
2026-03-28 11:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610 to the API
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:37Z',
 'fuel_type': 'diesel',
 'id': 'efe41a9f-043f-563b-bb4c-b8dddff86f96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC53610',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 354838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-01',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Diesel CD Active Sport',
 'transmission': 'manual',
 'trim': 'CD Active Sport',
 'year': 2007}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC53610%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Saving data for PC53610: {'auction_closing_time': 1774715557.0, 'created_time': 1774275470.745767, 'last_price_update_time': 1774696157.533235}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PC53610') HTTP/1.1" 204 0
2026-03-28 11:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c443ae57-5917-503b-9a28-3bc7a3a4f850 with identifier: AS51467
2026-03-28 11:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c443ae57-5917-503b-9a28-3bc7a3a4f850 with identifier: AS51467
2026-03-28 11:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c443ae57-5917-503b-9a28-3bc7a3a4f850 with identifier: AS51467 to the API
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:51:48Z',
 'fuel_type': 'diesel',
 'id': 'c443ae57-5917-503b-9a28-3bc7a3a4f850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS51467',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 189990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2018}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS51467%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Saving data for AS51467: {'auction_closing_time': 1774716708.0, 'created_time': 1774609578.118583, 'last_price_update_time': 1774696157.879623}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AS51467') HTTP/1.1" 204 0
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: KM47082
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ86442%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Scrape type for JZ86442: 0
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: VB06067
2026-03-28 11:09:17 [auto1.es] INFO: Found listing with ID: SA98238
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA98238%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.es] INFO: Scrape type for SA98238: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2 with identifier: SA98238
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2, identifier: SA98238
2026-03-28 11:09:18 [auto1.es] INFO: Found listing with ID: NZ54247
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ54247%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.es] INFO: Scrape type for NZ54247: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0bcc9d7-b777-5b70-8b33-e1baff165dfd with identifier: NZ54247
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0bcc9d7-b777-5b70-8b33-e1baff165dfd with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0bcc9d7-b777-5b70-8b33-e1baff165dfd with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d0bcc9d7-b777-5b70-8b33-e1baff165dfd, identifier: NZ54247
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2 with identifier: SA98238
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2 with identifier: SA98238
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e0662ad-50c2-55f6-90e8-a1da88a5e0f2 with identifier: SA98238 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:32Z',
 'fuel_type': 'petrol',
 'id': '6e0662ad-50c2-55f6-90e8-a1da88a5e0f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA98238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 226572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2008}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA98238%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.es] INFO: Saving data for SA98238: {'auction_closing_time': 1774715372.0, 'created_time': 1774609572.976722, 'last_price_update_time': 1774696158.37275}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA98238') HTTP/1.1" 204 0
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d0bcc9d7-b777-5b70-8b33-e1baff165dfd with identifier: NZ54247
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d0bcc9d7-b777-5b70-8b33-e1baff165dfd with identifier: NZ54247
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d0bcc9d7-b777-5b70-8b33-e1baff165dfd with identifier: NZ54247 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:50Z',
 'fuel_type': 'diesel',
 'id': 'd0bcc9d7-b777-5b70-8b33-e1baff165dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ54247',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 33683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-10',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 BLUE dCi L1H1 3,0t (8/9 Sitze) Start',
 'transmission': 'manual',
 'trim': 'L1H1 3,0t (8/9 Sitze) Start',
 'year': 2024}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ54247%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.es] INFO: Saving data for NZ54247: {'auction_closing_time': 1774716650.0, 'created_time': 1774609590.852801, 'last_price_update_time': 1774696158.653502}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ54247') HTTP/1.1" 204 0
2026-03-28 11:09:18 [auto1.es] INFO: Found listing with ID: LS65787
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS65787%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.es] INFO: Scrape type for LS65787: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7642aa52-ba18-50fd-b2ee-15673b64795a with identifier: LS65787
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7642aa52-ba18-50fd-b2ee-15673b64795a with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7642aa52-ba18-50fd-b2ee-15673b64795a with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7642aa52-ba18-50fd-b2ee-15673b64795a, identifier: LS65787
2026-03-28 11:09:18 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-28 11:09:18 [auto1.es] INFO: Found listing with ID: FR95558
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR95558%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.es] INFO: Scrape type for FR95558: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94ef2778-e6e1-5524-a908-3cdcf187de40 with identifier: FR95558
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94ef2778-e6e1-5524-a908-3cdcf187de40 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94ef2778-e6e1-5524-a908-3cdcf187de40 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 94ef2778-e6e1-5524-a908-3cdcf187de40, identifier: FR95558
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7642aa52-ba18-50fd-b2ee-15673b64795a with identifier: LS65787
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7642aa52-ba18-50fd-b2ee-15673b64795a with identifier: LS65787
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7642aa52-ba18-50fd-b2ee-15673b64795a with identifier: LS65787 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:41:29Z',
 'fuel_type': 'diesel',
 'id': '7642aa52-ba18-50fd-b2ee-15673b64795a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS65787',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 295106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Profesional',
 'transmission': 'manual',
 'trim': 'Profesional',
 'year': 2012}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS65787%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.es] INFO: Saving data for LS65787: {'auction_closing_time': 1774716089.0, 'created_time': 1774609576.146599, 'last_price_update_time': 1774696159.138477}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS65787') HTTP/1.1" 204 0
2026-03-28 11:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 94ef2778-e6e1-5524-a908-3cdcf187de40 with identifier: FR95558
2026-03-28 11:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 94ef2778-e6e1-5524-a908-3cdcf187de40 with identifier: FR95558
2026-03-28 11:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 94ef2778-e6e1-5524-a908-3cdcf187de40 with identifier: FR95558 to the API
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:20:20Z',
 'fuel_type': 'diesel',
 'id': '94ef2778-e6e1-5524-a908-3cdcf187de40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR95558',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 213863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-18',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi SX Familiar',
 'transmission': 'manual',
 'trim': 'SX Familiar',
 'year': 2007}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR95558%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.es] INFO: Saving data for FR95558: {'auction_closing_time': 1774714820.0, 'created_time': 1774609571.760444, 'last_price_update_time': 1774696159.40651}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FR95558') HTTP/1.1" 204 0
2026-03-28 11:09:19 [auto1.es] INFO: Found listing with ID: DA25807
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA25807%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.es] INFO: Scrape type for DA25807: 2
2026-03-28 11:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaf97361-6812-5423-9e9a-2b4cb28874e3 with identifier: DA25807
2026-03-28 11:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaf97361-6812-5423-9e9a-2b4cb28874e3 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaf97361-6812-5423-9e9a-2b4cb28874e3 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aaf97361-6812-5423-9e9a-2b4cb28874e3, identifier: DA25807
2026-03-28 11:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aaf97361-6812-5423-9e9a-2b4cb28874e3 with identifier: DA25807
2026-03-28 11:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aaf97361-6812-5423-9e9a-2b4cb28874e3 with identifier: DA25807
2026-03-28 11:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aaf97361-6812-5423-9e9a-2b4cb28874e3 with identifier: DA25807 to the API
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:56:53Z',
 'fuel_type': 'petrol',
 'id': 'aaf97361-6812-5423-9e9a-2b4cb28874e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA25807',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 144946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-30',
 'seller_name': None,
 'title': 'Smart forfour 1.3 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2004}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA25807%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.es] INFO: Saving data for DA25807: {'auction_closing_time': 1774717013.0, 'created_time': 1774609577.468667, 'last_price_update_time': 1774696159.821102}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DA25807') HTTP/1.1" 204 0
2026-03-28 11:09:19 [auto1.es] INFO: Found listing with ID: MA79555
2026-03-28 11:09:19 [auto1.es] INFO: Found listing with ID: TE50739
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE50739%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.es] INFO: Scrape type for TE50739: 0
2026-03-28 11:09:19 [auto1.es] INFO: Found listing with ID: VL49161
2026-03-28 11:09:19 [auto1.es] INFO: Found listing with ID: RT14519
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT14519%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.es] INFO: Scrape type for RT14519: 2
2026-03-28 11:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0962210e-fe45-5aa1-96e3-17d3926b5a37 with identifier: RT14519
2026-03-28 11:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0962210e-fe45-5aa1-96e3-17d3926b5a37 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0962210e-fe45-5aa1-96e3-17d3926b5a37 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0962210e-fe45-5aa1-96e3-17d3926b5a37, identifier: RT14519
2026-03-28 11:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0962210e-fe45-5aa1-96e3-17d3926b5a37 with identifier: RT14519
2026-03-28 11:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0962210e-fe45-5aa1-96e3-17d3926b5a37 with identifier: RT14519
2026-03-28 11:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0962210e-fe45-5aa1-96e3-17d3926b5a37 with identifier: RT14519 to the API
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:34Z',
 'fuel_type': 'diesel',
 'id': '0962210e-fe45-5aa1-96e3-17d3926b5a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT14519',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 442855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT14519%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.es] INFO: Saving data for RT14519: {'auction_closing_time': 1774714054.0, 'created_time': 1774469477.251432, 'last_price_update_time': 1774696160.229631}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT14519') HTTP/1.1" 204 0
2026-03-28 11:09:20 [auto1.es] INFO: Found listing with ID: WM24762
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM24762%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.es] INFO: Scrape type for WM24762: 0
2026-03-28 11:09:20 [auto1.es] INFO: Found listing with ID: JE26942
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE26942%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.es] INFO: Scrape type for JE26942: 0
2026-03-28 11:09:20 [auto1.es] INFO: Found listing with ID: XX85945
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX85945%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.es] INFO: Scrape type for XX85945: 2
2026-03-28 11:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849c88e4-b356-5eeb-8f3b-96cb7b3340d8 with identifier: XX85945
2026-03-28 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849c88e4-b356-5eeb-8f3b-96cb7b3340d8 with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849c88e4-b356-5eeb-8f3b-96cb7b3340d8 with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 849c88e4-b356-5eeb-8f3b-96cb7b3340d8, identifier: XX85945
2026-03-28 11:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 849c88e4-b356-5eeb-8f3b-96cb7b3340d8 with identifier: XX85945
2026-03-28 11:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 849c88e4-b356-5eeb-8f3b-96cb7b3340d8 with identifier: XX85945
2026-03-28 11:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 849c88e4-b356-5eeb-8f3b-96cb7b3340d8 with identifier: XX85945 to the API
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:04:37Z',
 'fuel_type': 'petrol',
 'id': '849c88e4-b356-5eeb-8f3b-96cb7b3340d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX85945',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 378783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-30',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2000}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX85945%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.es] INFO: Saving data for XX85945: {'auction_closing_time': 1774713877.0, 'created_time': 1774469534.600525, 'last_price_update_time': 1774696160.733398}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX85945') HTTP/1.1" 204 0
2026-03-28 11:09:20 [auto1.es] INFO: Found listing with ID: BT54234
2026-03-28 11:09:20 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE99512%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.es] INFO: Scrape type for BE99512: 2
2026-03-28 11:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88ac89b-f6eb-5720-bba4-410970a721fc with identifier: BE99512
2026-03-28 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88ac89b-f6eb-5720-bba4-410970a721fc with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d88ac89b-f6eb-5720-bba4-410970a721fc with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d88ac89b-f6eb-5720-bba4-410970a721fc, identifier: BE99512
2026-03-28 11:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d88ac89b-f6eb-5720-bba4-410970a721fc with identifier: BE99512
2026-03-28 11:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d88ac89b-f6eb-5720-bba4-410970a721fc with identifier: BE99512
2026-03-28 11:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d88ac89b-f6eb-5720-bba4-410970a721fc with identifier: BE99512 to the API
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:03:22Z',
 'fuel_type': 'diesel',
 'id': 'd88ac89b-f6eb-5720-bba4-410970a721fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE99512',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 137983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2022}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE99512%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.es] INFO: Saving data for BE99512: {'auction_closing_time': 1774713802.0, 'created_time': 1774609585.463683, 'last_price_update_time': 1774696161.104105}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE99512') HTTP/1.1" 204 0
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: CN53275
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: TF04725
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: RN90591
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN90591%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.es] INFO: Scrape type for RN90591: 0
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: TC61442
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC61442%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.es] INFO: Scrape type for TC61442: 0
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: PT49535
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: AL30564
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL30564%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.es] INFO: Scrape type for AL30564: 2
2026-03-28 11:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e30790e-69dd-5e26-8a86-4b4f74003468 with identifier: AL30564
2026-03-28 11:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e30790e-69dd-5e26-8a86-4b4f74003468 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e30790e-69dd-5e26-8a86-4b4f74003468 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e30790e-69dd-5e26-8a86-4b4f74003468, identifier: AL30564
2026-03-28 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e30790e-69dd-5e26-8a86-4b4f74003468 with identifier: AL30564
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e30790e-69dd-5e26-8a86-4b4f74003468 with identifier: AL30564
2026-03-28 11:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e30790e-69dd-5e26-8a86-4b4f74003468 with identifier: AL30564 to the API
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:04:19Z',
 'fuel_type': 'gas',
 'id': '4e30790e-69dd-5e26-8a86-4b4f74003468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL30564',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker Express',
 'odometer': 162379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Dacia Dokker Express 1.6 SCe Benzin / LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2019}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL30564%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.es] INFO: Saving data for AL30564: {'auction_closing_time': 1774713859.0, 'created_time': 1774609587.919117, 'last_price_update_time': 1774696161.698021}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL30564') HTTP/1.1" 204 0
2026-03-28 11:09:21 [auto1.es] INFO: Found listing with ID: KE47103
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE47103%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.es] INFO: Scrape type for KE47103: 2
2026-03-28 11:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7edb5182-c25b-5b65-91f0-891025b53132 with identifier: KE47103
2026-03-28 11:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7edb5182-c25b-5b65-91f0-891025b53132 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7edb5182-c25b-5b65-91f0-891025b53132 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7edb5182-c25b-5b65-91f0-891025b53132, identifier: KE47103
2026-03-28 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7edb5182-c25b-5b65-91f0-891025b53132 with identifier: KE47103
2026-03-28 11:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7edb5182-c25b-5b65-91f0-891025b53132 with identifier: KE47103
2026-03-28 11:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7edb5182-c25b-5b65-91f0-891025b53132 with identifier: KE47103 to the API
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:37Z',
 'fuel_type': 'diesel',
 'id': '7edb5182-c25b-5b65-91f0-891025b53132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE47103',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 95890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-16',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Seduction',
 'transmission': 'automatic',
 'trim': 'Seduction',
 'year': 2011}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE47103%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.es] INFO: Saving data for KE47103: {'auction_closing_time': 1774714897.0, 'created_time': 1774609583.151527, 'last_price_update_time': 1774696162.1508}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE47103') HTTP/1.1" 204 0
2026-03-28 11:09:22 [auto1.es] INFO: Found listing with ID: SF05146
2026-03-28 11:09:22 [auto1.es] INFO: Found listing with ID: GX55521
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX55521%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.es] INFO: Scrape type for GX55521: 2
2026-03-28 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048b3049-2c7e-5dbc-b177-93bf225b6f05 with identifier: GX55521
2026-03-28 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048b3049-2c7e-5dbc-b177-93bf225b6f05 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048b3049-2c7e-5dbc-b177-93bf225b6f05 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 048b3049-2c7e-5dbc-b177-93bf225b6f05, identifier: GX55521
2026-03-28 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 048b3049-2c7e-5dbc-b177-93bf225b6f05 with identifier: GX55521
2026-03-28 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 048b3049-2c7e-5dbc-b177-93bf225b6f05 with identifier: GX55521
2026-03-28 11:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 048b3049-2c7e-5dbc-b177-93bf225b6f05 with identifier: GX55521 to the API
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:12:27Z',
 'fuel_type': 'hybrid',
 'id': '048b3049-2c7e-5dbc-b177-93bf225b6f05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX55521',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 68040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-24',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX55521%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.es] INFO: Saving data for GX55521: {'auction_closing_time': 1774714347.0, 'created_time': 1774609582.18553, 'last_price_update_time': 1774696162.525118}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GX55521') HTTP/1.1" 204 0
2026-03-28 11:09:22 [auto1.es] INFO: Found listing with ID: EL12224
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL12224%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.es] INFO: Scrape type for EL12224: 2
2026-03-28 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccaec166-353a-5402-a361-241e42b959c9 with identifier: EL12224
2026-03-28 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccaec166-353a-5402-a361-241e42b959c9 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccaec166-353a-5402-a361-241e42b959c9 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ccaec166-353a-5402-a361-241e42b959c9, identifier: EL12224
2026-03-28 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ccaec166-353a-5402-a361-241e42b959c9 with identifier: EL12224
2026-03-28 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ccaec166-353a-5402-a361-241e42b959c9 with identifier: EL12224
2026-03-28 11:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ccaec166-353a-5402-a361-241e42b959c9 with identifier: EL12224 to the API
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:58:45Z',
 'fuel_type': 'diesel',
 'id': 'ccaec166-353a-5402-a361-241e42b959c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL12224',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 143335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Furgón Professional',
 'transmission': 'manual',
 'trim': 'Furgón Professional',
 'year': 2021}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL12224%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.es] INFO: Saving data for EL12224: {'auction_closing_time': 1774717125.0, 'created_time': 1774609613.680088, 'last_price_update_time': 1774696162.928288}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EL12224') HTTP/1.1" 204 0
2026-03-28 11:09:22 [auto1.es] INFO: Channel: 24h | Page: 57 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:22 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE07728%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.es] INFO: Scrape type for EE07728: 2
2026-03-28 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85 with identifier: EE07728
2026-03-28 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85, identifier: EE07728
2026-03-28 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85 with identifier: EE07728
2026-03-28 11:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85 with identifier: EE07728
2026-03-28 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85 with identifier: EE07728 to the API
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:25Z',
 'fuel_type': 'diesel',
 'id': 'bd8c8fa1-3a7a-5694-bef2-0deb51f9bc85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE07728',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 187864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Style+ 2WD',
 'transmission': 'manual',
 'trim': 'Style+ 2WD',
 'year': 2016}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE07728%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.es] INFO: Saving data for EE07728: {'auction_closing_time': 1774715665.0, 'created_time': 1774609599.745169, 'last_price_update_time': 1774696163.311284}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EE07728') HTTP/1.1" 204 0
2026-03-28 11:09:23 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-28 11:09:23 [auto1.es] INFO: Found listing with ID: BP19645
2026-03-28 11:09:23 [auto1.es] INFO: Found listing with ID: RB19136
2026-03-28 11:09:23 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-28 11:09:23 [auto1.es] INFO: Found listing with ID: EL32039
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL32039%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.es] INFO: Scrape type for EL32039: 2
2026-03-28 11:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa37f2d6-b57b-574b-be1f-f2dd29e90777 with identifier: EL32039
2026-03-28 11:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa37f2d6-b57b-574b-be1f-f2dd29e90777 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa37f2d6-b57b-574b-be1f-f2dd29e90777 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa37f2d6-b57b-574b-be1f-f2dd29e90777, identifier: EL32039
2026-03-28 11:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:23 [auto1.es] INFO: Found listing with ID: LB97818
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB97818%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.es] INFO: Scrape type for LB97818: 2
2026-03-28 11:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f59ee86-f8ec-5673-be2b-0eb5f1949201 with identifier: LB97818
2026-03-28 11:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f59ee86-f8ec-5673-be2b-0eb5f1949201 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f59ee86-f8ec-5673-be2b-0eb5f1949201 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f59ee86-f8ec-5673-be2b-0eb5f1949201, identifier: LB97818
2026-03-28 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa37f2d6-b57b-574b-be1f-f2dd29e90777 with identifier: EL32039
2026-03-28 11:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa37f2d6-b57b-574b-be1f-f2dd29e90777 with identifier: EL32039
2026-03-28 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa37f2d6-b57b-574b-be1f-f2dd29e90777 with identifier: EL32039 to the API
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:03Z',
 'fuel_type': 'diesel',
 'id': 'fa37f2d6-b57b-574b-be1f-f2dd29e90777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL32039',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 132482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-06',
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TDI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'BlueMotion Tech',
 'year': 2016}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL32039%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.es] INFO: Saving data for EL32039: {'auction_closing_time': 1774716303.0, 'created_time': 1774609599.38081, 'last_price_update_time': 1774696163.788202}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EL32039') HTTP/1.1" 204 0
2026-03-28 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f59ee86-f8ec-5673-be2b-0eb5f1949201 with identifier: LB97818
2026-03-28 11:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f59ee86-f8ec-5673-be2b-0eb5f1949201 with identifier: LB97818
2026-03-28 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f59ee86-f8ec-5673-be2b-0eb5f1949201 with identifier: LB97818 to the API
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:26Z',
 'fuel_type': 'diesel',
 'id': '8f59ee86-f8ec-5673-be2b-0eb5f1949201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB97818',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 25438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-26',
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Double Cab Le Cap 4WD',
 'transmission': 'automatic',
 'trim': 'Double Cab Le Cap 4WD',
 'year': 2022}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB97818%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.es] INFO: Saving data for LB97818: {'auction_closing_time': 1774715966.0, 'created_time': 1774609583.872142, 'last_price_update_time': 1774696164.150722}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LB97818') HTTP/1.1" 204 0
2026-03-28 11:09:24 [auto1.es] INFO: Found listing with ID: YD48242
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD48242%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.es] INFO: Scrape type for YD48242: 2
2026-03-28 11:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b660aa7-2539-5cf2-95aa-5ca1460a51c7 with identifier: YD48242
2026-03-28 11:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b660aa7-2539-5cf2-95aa-5ca1460a51c7 with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b660aa7-2539-5cf2-95aa-5ca1460a51c7 with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b660aa7-2539-5cf2-95aa-5ca1460a51c7, identifier: YD48242
2026-03-28 11:09:24 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU20973%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.es] INFO: Scrape type for SU20973: 2
2026-03-28 11:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36d3638-a0db-5144-adc7-f3dcee28673f with identifier: SU20973
2026-03-28 11:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36d3638-a0db-5144-adc7-f3dcee28673f with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f36d3638-a0db-5144-adc7-f3dcee28673f with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f36d3638-a0db-5144-adc7-f3dcee28673f, identifier: SU20973
2026-03-28 11:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b660aa7-2539-5cf2-95aa-5ca1460a51c7 with identifier: YD48242
2026-03-28 11:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b660aa7-2539-5cf2-95aa-5ca1460a51c7 with identifier: YD48242
2026-03-28 11:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b660aa7-2539-5cf2-95aa-5ca1460a51c7 with identifier: YD48242 to the API
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:21Z',
 'fuel_type': 'diesel',
 'id': '5b660aa7-2539-5cf2-95aa-5ca1460a51c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD48242',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Toledo',
 'odometer': 291965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-30',
 'seller_name': None,
 'title': 'Seat Toledo 1.9 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2007}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD48242%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.es] INFO: Saving data for YD48242: {'auction_closing_time': 1774714221.0, 'created_time': 1774609596.33345, 'last_price_update_time': 1774696164.674825}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YD48242') HTTP/1.1" 204 0
2026-03-28 11:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f36d3638-a0db-5144-adc7-f3dcee28673f with identifier: SU20973
2026-03-28 11:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f36d3638-a0db-5144-adc7-f3dcee28673f with identifier: SU20973
2026-03-28 11:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f36d3638-a0db-5144-adc7-f3dcee28673f with identifier: SU20973 to the API
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:49:02Z',
 'fuel_type': 'petrol',
 'id': 'f36d3638-a0db-5144-adc7-f3dcee28673f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU20973',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 179105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-24',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Sol',
 'transmission': 'manual',
 'trim': 'Compact Sol',
 'year': 2005}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU20973%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Saving data for SU20973: {'auction_closing_time': 1774716542.0, 'created_time': 1773432336.778185, 'last_price_update_time': 1774696165.024834}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU20973') HTTP/1.1" 204 0
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB84191%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Scrape type for SB84191: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a05e5a-c185-543f-ade7-f7fa3b20b181 with identifier: SB84191
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a05e5a-c185-543f-ade7-f7fa3b20b181 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90a05e5a-c185-543f-ade7-f7fa3b20b181 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90a05e5a-c185-543f-ade7-f7fa3b20b181, identifier: SB84191
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: DL40805
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: AW49477
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: TB74372
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU79245%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Scrape type for LU79245: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96131ebd-18fb-50e6-bdf7-992e11630c59 with identifier: LU79245
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96131ebd-18fb-50e6-bdf7-992e11630c59 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96131ebd-18fb-50e6-bdf7-992e11630c59 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96131ebd-18fb-50e6-bdf7-992e11630c59, identifier: LU79245
2026-03-28 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90a05e5a-c185-543f-ade7-f7fa3b20b181 with identifier: SB84191
2026-03-28 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90a05e5a-c185-543f-ade7-f7fa3b20b181 with identifier: SB84191
2026-03-28 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90a05e5a-c185-543f-ade7-f7fa3b20b181 with identifier: SB84191 to the API
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:53Z',
 'fuel_type': 'petrol',
 'id': '90a05e5a-c185-543f-ade7-f7fa3b20b181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB84191',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 84306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2018}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB84191%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Saving data for SB84191: {'auction_closing_time': 1774715273.0, 'created_time': 1774609588.307142, 'last_price_update_time': 1774696165.519272}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB84191') HTTP/1.1" 204 0
2026-03-28 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96131ebd-18fb-50e6-bdf7-992e11630c59 with identifier: LU79245
2026-03-28 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96131ebd-18fb-50e6-bdf7-992e11630c59 with identifier: LU79245
2026-03-28 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 96131ebd-18fb-50e6-bdf7-992e11630c59 with identifier: LU79245 to the API
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:22:11Z',
 'fuel_type': 'diesel',
 'id': '96131ebd-18fb-50e6-bdf7-992e11630c59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU79245',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 61129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU79245%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Saving data for LU79245: {'auction_closing_time': 1774714931.0, 'created_time': 1773129413.55278, 'last_price_update_time': 1774696165.817507}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LU79245') HTTP/1.1" 204 0
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: UA88301
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA88301%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Scrape type for UA88301: 0
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: TT54847
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT54847%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Scrape type for TT54847: 0
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: MF03574
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: AJ53679
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: AJ63740
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: MG24035
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG24035%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.es] INFO: Scrape type for MG24035: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dede42c-ec08-58d6-893b-feeeb9565498 with identifier: MG24035
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dede42c-ec08-58d6-893b-feeeb9565498 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dede42c-ec08-58d6-893b-feeeb9565498 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2dede42c-ec08-58d6-893b-feeeb9565498, identifier: MG24035
2026-03-28 11:09:25 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV28339%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.es] INFO: Scrape type for RV28339: 2
2026-03-28 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a70a19fc-65f4-5fd0-a880-ac06b89f07c8 with identifier: RV28339
2026-03-28 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a70a19fc-65f4-5fd0-a880-ac06b89f07c8 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a70a19fc-65f4-5fd0-a880-ac06b89f07c8 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a70a19fc-65f4-5fd0-a880-ac06b89f07c8, identifier: RV28339
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2dede42c-ec08-58d6-893b-feeeb9565498 with identifier: MG24035
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2dede42c-ec08-58d6-893b-feeeb9565498 with identifier: MG24035
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2dede42c-ec08-58d6-893b-feeeb9565498 with identifier: MG24035 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:44Z',
 'fuel_type': 'diesel',
 'id': '2dede42c-ec08-58d6-893b-feeeb9565498',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG24035',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 304316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG24035%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.es] INFO: Saving data for MG24035: {'auction_closing_time': 1774714124.0, 'created_time': 1774609623.303563, 'last_price_update_time': 1774696166.33377}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG24035') HTTP/1.1" 204 0
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a70a19fc-65f4-5fd0-a880-ac06b89f07c8 with identifier: RV28339
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a70a19fc-65f4-5fd0-a880-ac06b89f07c8 with identifier: RV28339
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a70a19fc-65f4-5fd0-a880-ac06b89f07c8 with identifier: RV28339 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'diesel',
 'id': 'a70a19fc-65f4-5fd0-a880-ac06b89f07c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV28339',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 114765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2015}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV28339%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.es] INFO: Saving data for RV28339: {'auction_closing_time': 1774715579.0, 'created_time': 1774609594.760189, 'last_price_update_time': 1774696166.693977}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV28339') HTTP/1.1" 204 0
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: AG87385
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: XW95149
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: SY91293
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC49855%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.es] INFO: Scrape type for JC49855: 0
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: DM43927
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: ZH88989
2026-03-28 11:09:26 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV04114%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.es] INFO: Scrape type for AV04114: 2
2026-03-28 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5cb0ee8-55fc-5e04-bea0-994a9e641c83 with identifier: AV04114
2026-03-28 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5cb0ee8-55fc-5e04-bea0-994a9e641c83 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5cb0ee8-55fc-5e04-bea0-994a9e641c83 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5cb0ee8-55fc-5e04-bea0-994a9e641c83, identifier: AV04114
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5cb0ee8-55fc-5e04-bea0-994a9e641c83 with identifier: AV04114
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5cb0ee8-55fc-5e04-bea0-994a9e641c83 with identifier: AV04114
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c5cb0ee8-55fc-5e04-bea0-994a9e641c83 with identifier: AV04114 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:31:12Z',
 'fuel_type': 'diesel',
 'id': 'c5cb0ee8-55fc-5e04-bea0-994a9e641c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV04114',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 474690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-27',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV04114%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.es] INFO: Saving data for AV04114: {'auction_closing_time': 1774715472.0, 'created_time': 1774609608.271554, 'last_price_update_time': 1774696167.099869}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV04114') HTTP/1.1" 204 0
2026-03-28 11:09:27 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-28 11:09:27 [auto1.es] INFO: Found listing with ID: JB50336
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB50336%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.es] INFO: Scrape type for JB50336: 0
2026-03-28 11:09:27 [auto1.es] INFO: Found listing with ID: XJ92197
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ92197%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.es] INFO: Scrape type for XJ92197: 2
2026-03-28 11:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ffb806-2c22-5d8b-bd73-eb84477ee4e7 with identifier: XJ92197
2026-03-28 11:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12ffb806-2c22-5d8b-bd73-eb84477ee4e7 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12ffb806-2c22-5d8b-bd73-eb84477ee4e7 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12ffb806-2c22-5d8b-bd73-eb84477ee4e7, identifier: XJ92197
2026-03-28 11:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12ffb806-2c22-5d8b-bd73-eb84477ee4e7 with identifier: XJ92197
2026-03-28 11:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12ffb806-2c22-5d8b-bd73-eb84477ee4e7 with identifier: XJ92197
2026-03-28 11:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 12ffb806-2c22-5d8b-bd73-eb84477ee4e7 with identifier: XJ92197 to the API
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:21Z',
 'fuel_type': 'petrol',
 'id': '12ffb806-2c22-5d8b-bd73-eb84477ee4e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ92197',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 64775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-17',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ92197%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.es] INFO: Saving data for XJ92197: {'auction_closing_time': 1774716021.0, 'created_time': 1773324467.400402, 'last_price_update_time': 1774696167.529804}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ92197') HTTP/1.1" 204 0
2026-03-28 11:09:27 [auto1.es] INFO: Found listing with ID: TV08054
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV08054%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.es] INFO: Scrape type for TV08054: 2
2026-03-28 11:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b401cd2c-884c-5c5e-a3a8-8706206e73f5 with identifier: TV08054
2026-03-28 11:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b401cd2c-884c-5c5e-a3a8-8706206e73f5 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b401cd2c-884c-5c5e-a3a8-8706206e73f5 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b401cd2c-884c-5c5e-a3a8-8706206e73f5, identifier: TV08054
2026-03-28 11:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b401cd2c-884c-5c5e-a3a8-8706206e73f5 with identifier: TV08054
2026-03-28 11:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b401cd2c-884c-5c5e-a3a8-8706206e73f5 with identifier: TV08054
2026-03-28 11:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b401cd2c-884c-5c5e-a3a8-8706206e73f5 with identifier: TV08054 to the API
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:15:06Z',
 'fuel_type': 'petrol',
 'id': 'b401cd2c-884c-5c5e-a3a8-8706206e73f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV08054',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 138993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-28',
 'seller_name': None,
 'title': 'Opel Vectra 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2001}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV08054%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.es] INFO: Saving data for TV08054: {'auction_closing_time': 1774714506.0, 'created_time': 1774609628.028176, 'last_price_update_time': 1774696167.900892}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV08054') HTTP/1.1" 204 0
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: MA21066
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA21066%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Scrape type for MA21066: 0
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: UK85840
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: HZ40578
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ40578%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Scrape type for HZ40578: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41901db-e5b6-5bad-88ea-db26cc1cc6b6 with identifier: HZ40578
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41901db-e5b6-5bad-88ea-db26cc1cc6b6 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41901db-e5b6-5bad-88ea-db26cc1cc6b6 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d41901db-e5b6-5bad-88ea-db26cc1cc6b6, identifier: HZ40578
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d41901db-e5b6-5bad-88ea-db26cc1cc6b6 with identifier: HZ40578
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d41901db-e5b6-5bad-88ea-db26cc1cc6b6 with identifier: HZ40578
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d41901db-e5b6-5bad-88ea-db26cc1cc6b6 with identifier: HZ40578 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:00Z',
 'fuel_type': 'diesel',
 'id': 'd41901db-e5b6-5bad-88ea-db26cc1cc6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ40578',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 233037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ40578%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Saving data for HZ40578: {'auction_closing_time': 1774716300.0, 'created_time': 1774609624.23572, 'last_price_update_time': 1774696168.353325}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ40578') HTTP/1.1" 204 0
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: AH95116
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: ML07808
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: NE97244
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: UF15640
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF15640%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Scrape type for UF15640: 0
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: UV13351
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: JY25444
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: CU51757
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU51757%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Scrape type for CU51757: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea825d15-f424-5c09-a159-5f98803ecba3 with identifier: CU51757
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea825d15-f424-5c09-a159-5f98803ecba3 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea825d15-f424-5c09-a159-5f98803ecba3 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea825d15-f424-5c09-a159-5f98803ecba3, identifier: CU51757
2026-03-28 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea825d15-f424-5c09-a159-5f98803ecba3 with identifier: CU51757
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea825d15-f424-5c09-a159-5f98803ecba3 with identifier: CU51757
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea825d15-f424-5c09-a159-5f98803ecba3 with identifier: CU51757 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:01Z',
 'fuel_type': 'diesel',
 'id': 'ea825d15-f424-5c09-a159-5f98803ecba3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU51757',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 229880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-18',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU51757%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Saving data for CU51757: {'auction_closing_time': 1774714381.0, 'created_time': 1774609632.864512, 'last_price_update_time': 1774696168.786233}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CU51757') HTTP/1.1" 204 0
2026-03-28 11:09:28 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY86051%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.es] INFO: Scrape type for EY86051: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c31f812-678b-50be-9c37-12225fb0bc97 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c31f812-678b-50be-9c37-12225fb0bc97 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c31f812-678b-50be-9c37-12225fb0bc97, identifier: EY86051
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:04:21Z',
 'fuel_type': 'diesel',
 'id': '9c31f812-678b-50be-9c37-12225fb0bc97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY86051',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 230862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'BMW 1er 116d Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY86051%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.es] INFO: Saving data for EY86051: {'auction_closing_time': 1774713861.0, 'created_time': 1774609619.875632, 'last_price_update_time': 1774696169.18729}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY86051') HTTP/1.1" 204 0
2026-03-28 11:09:29 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-28 11:09:29 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB97215%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.es] INFO: Scrape type for NB97215: 2
2026-03-28 11:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0464375-b4e3-50cf-8bb8-5487ce0fb2b6 with identifier: NB97215
2026-03-28 11:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0464375-b4e3-50cf-8bb8-5487ce0fb2b6 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0464375-b4e3-50cf-8bb8-5487ce0fb2b6 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0464375-b4e3-50cf-8bb8-5487ce0fb2b6, identifier: NB97215
2026-03-28 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0464375-b4e3-50cf-8bb8-5487ce0fb2b6 with identifier: NB97215
2026-03-28 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0464375-b4e3-50cf-8bb8-5487ce0fb2b6 with identifier: NB97215
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f0464375-b4e3-50cf-8bb8-5487ce0fb2b6 with identifier: NB97215 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:51:19Z',
 'fuel_type': 'diesel',
 'id': 'f0464375-b4e3-50cf-8bb8-5487ce0fb2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB97215',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 328862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB97215%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.es] INFO: Saving data for NB97215: {'auction_closing_time': 1774716679.0, 'created_time': 1774609621.810975, 'last_price_update_time': 1774696169.658007}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NB97215') HTTP/1.1" 204 0
2026-03-28 11:09:29 [auto1.es] INFO: Channel: 24h | Page: 58 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:29 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK58195%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.es] INFO: Scrape type for PK58195: 2
2026-03-28 11:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb547f9-61c4-5bf9-9d9e-90e174851f12 with identifier: PK58195
2026-03-28 11:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb547f9-61c4-5bf9-9d9e-90e174851f12 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eb547f9-61c4-5bf9-9d9e-90e174851f12 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2eb547f9-61c4-5bf9-9d9e-90e174851f12, identifier: PK58195
2026-03-28 11:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2eb547f9-61c4-5bf9-9d9e-90e174851f12 with identifier: PK58195
2026-03-28 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2eb547f9-61c4-5bf9-9d9e-90e174851f12 with identifier: PK58195
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2eb547f9-61c4-5bf9-9d9e-90e174851f12 with identifier: PK58195 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:20Z',
 'fuel_type': 'petrol',
 'id': '2eb547f9-61c4-5bf9-9d9e-90e174851f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK58195',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 66607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-17',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TSI FR 4Drive',
 'transmission': 'automatic',
 'trim': 'FR 4Drive',
 'year': 2019}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK58195%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Saving data for PK58195: {'auction_closing_time': 1774716980.0, 'created_time': 1774609624.586353, 'last_price_update_time': 1774696170.075445}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK58195') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK92990%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Scrape type for NK92990: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae932452-1612-5160-9a38-c5b51deb04db with identifier: NK92990
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae932452-1612-5160-9a38-c5b51deb04db with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae932452-1612-5160-9a38-c5b51deb04db with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae932452-1612-5160-9a38-c5b51deb04db, identifier: NK92990
2026-03-28 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae932452-1612-5160-9a38-c5b51deb04db with identifier: NK92990
2026-03-28 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae932452-1612-5160-9a38-c5b51deb04db with identifier: NK92990
2026-03-28 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ae932452-1612-5160-9a38-c5b51deb04db with identifier: NK92990 to the API
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:35:38Z',
 'fuel_type': 'petrol',
 'id': 'ae932452-1612-5160-9a38-c5b51deb04db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK92990',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 139913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-16',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK92990%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Saving data for NK92990: {'auction_closing_time': 1774715738.0, 'created_time': 1773951381.61278, 'last_price_update_time': 1774696170.473555}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NK92990') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11281%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Scrape type for AB11281: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba11b7d9-d7a5-5a54-a665-5eabb77d62dc with identifier: AB11281
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba11b7d9-d7a5-5a54-a665-5eabb77d62dc with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba11b7d9-d7a5-5a54-a665-5eabb77d62dc with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba11b7d9-d7a5-5a54-a665-5eabb77d62dc, identifier: AB11281
2026-03-28 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba11b7d9-d7a5-5a54-a665-5eabb77d62dc with identifier: AB11281
2026-03-28 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba11b7d9-d7a5-5a54-a665-5eabb77d62dc with identifier: AB11281
2026-03-28 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba11b7d9-d7a5-5a54-a665-5eabb77d62dc with identifier: AB11281 to the API
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:32:28Z',
 'fuel_type': 'diesel',
 'id': 'ba11b7d9-d7a5-5a54-a665-5eabb77d62dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB11281',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 395040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11281%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Saving data for AB11281: {'auction_closing_time': 1774715548.0, 'created_time': 1773691597.439156, 'last_price_update_time': 1774696170.872894}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AB11281') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN52396%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Scrape type for GN52396: 0
2026-03-28 11:09:30 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA21810%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.es] INFO: Scrape type for ZA21810: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56aed832-fcf2-56cc-8819-6b3dc542ce81 with identifier: ZA21810
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56aed832-fcf2-56cc-8819-6b3dc542ce81 with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56aed832-fcf2-56cc-8819-6b3dc542ce81 with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 56aed832-fcf2-56cc-8819-6b3dc542ce81, identifier: ZA21810
2026-03-28 11:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 56aed832-fcf2-56cc-8819-6b3dc542ce81 with identifier: ZA21810
2026-03-28 11:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 56aed832-fcf2-56cc-8819-6b3dc542ce81 with identifier: ZA21810
2026-03-28 11:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 56aed832-fcf2-56cc-8819-6b3dc542ce81 with identifier: ZA21810 to the API
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:04:38Z',
 'fuel_type': 'petrol',
 'id': '56aed832-fcf2-56cc-8819-6b3dc542ce81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA21810',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 55292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.5 T-GDI Limited 4x2',
 'transmission': 'manual',
 'trim': 'Limited 4x2',
 'year': 2020}
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA21810%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [auto1.es] INFO: Saving data for ZA21810: {'auction_closing_time': 1774713878.0, 'created_time': 1774296366.012297, 'last_price_update_time': 1774696171.696348}
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA21810') HTTP/1.1" 204 0
2026-03-28 11:09:31 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ36748%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [auto1.es] INFO: Scrape type for BJ36748: 2
2026-03-28 11:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 314fa4ed-d883-5f54-9ee8-cd931b17cb93 with identifier: BJ36748
2026-03-28 11:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 314fa4ed-d883-5f54-9ee8-cd931b17cb93 with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 314fa4ed-d883-5f54-9ee8-cd931b17cb93 with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 314fa4ed-d883-5f54-9ee8-cd931b17cb93, identifier: BJ36748
2026-03-28 11:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 314fa4ed-d883-5f54-9ee8-cd931b17cb93 with identifier: BJ36748
2026-03-28 11:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 314fa4ed-d883-5f54-9ee8-cd931b17cb93 with identifier: BJ36748
2026-03-28 11:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 314fa4ed-d883-5f54-9ee8-cd931b17cb93 with identifier: BJ36748 to the API
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:24:36Z',
 'fuel_type': 'petrol',
 'id': '314fa4ed-d883-5f54-9ee8-cd931b17cb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ36748',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 147245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-08',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2005}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ36748%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.es] INFO: Saving data for BJ36748: {'auction_closing_time': 1774715076.0, 'created_time': 1773131638.866929, 'last_price_update_time': 1774696172.136749}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BJ36748') HTTP/1.1" 204 0
2026-03-28 11:09:32 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV93278%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.es] INFO: Scrape type for AV93278: 0
2026-03-28 11:09:32 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-28 11:09:32 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61086%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.es] INFO: Scrape type for MA61086: 2
2026-03-28 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4103362f-9e1b-5ad7-8bc7-6a42ed35d221 with identifier: MA61086
2026-03-28 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4103362f-9e1b-5ad7-8bc7-6a42ed35d221 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4103362f-9e1b-5ad7-8bc7-6a42ed35d221 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4103362f-9e1b-5ad7-8bc7-6a42ed35d221, identifier: MA61086
2026-03-28 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4103362f-9e1b-5ad7-8bc7-6a42ed35d221 with identifier: MA61086
2026-03-28 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4103362f-9e1b-5ad7-8bc7-6a42ed35d221 with identifier: MA61086
2026-03-28 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4103362f-9e1b-5ad7-8bc7-6a42ed35d221 with identifier: MA61086 to the API
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:01:49Z',
 'fuel_type': 'diesel',
 'id': '4103362f-9e1b-5ad7-8bc7-6a42ed35d221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA61086',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4 Crossback',
 'odometer': 188658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'DS Automobiles DS4 Crossback 2.0 Blue-HDi SportChic',
 'transmission': 'automatic',
 'trim': 'SportChic',
 'year': 2016}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61086%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.es] INFO: Saving data for MA61086: {'auction_closing_time': 1774713709.0, 'created_time': 1773129721.133546, 'last_price_update_time': 1774696172.640118}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA61086') HTTP/1.1" 204 0
2026-03-28 11:09:32 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS45222%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.es] INFO: Scrape type for PS45222: 2
2026-03-28 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5275ea18-02f6-59cc-bd02-16010c623548 with identifier: PS45222
2026-03-28 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5275ea18-02f6-59cc-bd02-16010c623548 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5275ea18-02f6-59cc-bd02-16010c623548 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5275ea18-02f6-59cc-bd02-16010c623548, identifier: PS45222
2026-03-28 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5275ea18-02f6-59cc-bd02-16010c623548 with identifier: PS45222
2026-03-28 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5275ea18-02f6-59cc-bd02-16010c623548 with identifier: PS45222
2026-03-28 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5275ea18-02f6-59cc-bd02-16010c623548 with identifier: PS45222 to the API
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:20:44Z',
 'fuel_type': 'diesel',
 'id': '5275ea18-02f6-59cc-bd02-16010c623548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS45222',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 106695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-31',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.3 JTD Multijet Dynamic',
 'transmission': 'automatic',
 'trim': 'Multijet Dynamic',
 'year': 2007}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS45222%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.es] INFO: Saving data for PS45222: {'auction_closing_time': 1774714844.0, 'created_time': 1773128125.969702, 'last_price_update_time': 1774696173.025706}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS45222') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-28 11:09:33 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-28 11:09:33 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR67716%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.es] INFO: Scrape type for KR67716: 2
2026-03-28 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f6e515-e321-5f71-9ffb-5ddce02b7580 with identifier: KR67716
2026-03-28 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f6e515-e321-5f71-9ffb-5ddce02b7580 with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8f6e515-e321-5f71-9ffb-5ddce02b7580 with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8f6e515-e321-5f71-9ffb-5ddce02b7580, identifier: KR67716
2026-03-28 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8f6e515-e321-5f71-9ffb-5ddce02b7580 with identifier: KR67716
2026-03-28 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8f6e515-e321-5f71-9ffb-5ddce02b7580 with identifier: KR67716
2026-03-28 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8f6e515-e321-5f71-9ffb-5ddce02b7580 with identifier: KR67716 to the API
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:00:43Z',
 'fuel_type': 'diesel',
 'id': 'c8f6e515-e321-5f71-9ffb-5ddce02b7580',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR67716',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 170318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-08',
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'automatic',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2019}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR67716%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.es] INFO: Saving data for KR67716: {'auction_closing_time': 1774713643.0, 'created_time': 1773864321.054629, 'last_price_update_time': 1774696173.456933}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KR67716') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ88130%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.es] INFO: Scrape type for NZ88130: 2
2026-03-28 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a0087b-0903-58b6-98c9-faeb452522d8 with identifier: NZ88130
2026-03-28 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a0087b-0903-58b6-98c9-faeb452522d8 with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a0087b-0903-58b6-98c9-faeb452522d8 with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29a0087b-0903-58b6-98c9-faeb452522d8, identifier: NZ88130
2026-03-28 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29a0087b-0903-58b6-98c9-faeb452522d8 with identifier: NZ88130
2026-03-28 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29a0087b-0903-58b6-98c9-faeb452522d8 with identifier: NZ88130
2026-03-28 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29a0087b-0903-58b6-98c9-faeb452522d8 with identifier: NZ88130 to the API
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:38:31Z',
 'fuel_type': 'diesel',
 'id': '29a0087b-0903-58b6-98c9-faeb452522d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ88130',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 139436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2020}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ88130%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.es] INFO: Saving data for NZ88130: {'auction_closing_time': 1774715911.0, 'created_time': 1773129727.50456, 'last_price_update_time': 1774696173.973546}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ88130') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.es] INFO: Found listing with ID: EA95786
2026-03-28 11:09:33 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS59468%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.es] INFO: Scrape type for GS59468: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3e75947-bb9d-5242-917c-4052e957a17c with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3e75947-bb9d-5242-917c-4052e957a17c with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3e75947-bb9d-5242-917c-4052e957a17c, identifier: GS59468
2026-03-28 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468
2026-03-28 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:47:02Z',
 'fuel_type': 'diesel',
 'id': 'e3e75947-bb9d-5242-917c-4052e957a17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS59468',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 182955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-22',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2015}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS59468%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.es] INFO: Saving data for GS59468: {'auction_closing_time': 1774716422.0, 'created_time': 1773128917.79335, 'last_price_update_time': 1774696174.366062}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GS59468') HTTP/1.1" 204 0
2026-03-28 11:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:34 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL01395%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.es] INFO: Scrape type for NL01395: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b716f9-2140-50f2-bf7c-3d65497f8c80 with identifier: NL01395
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b716f9-2140-50f2-bf7c-3d65497f8c80 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b716f9-2140-50f2-bf7c-3d65497f8c80 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85b716f9-2140-50f2-bf7c-3d65497f8c80, identifier: NL01395
2026-03-28 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85b716f9-2140-50f2-bf7c-3d65497f8c80 with identifier: NL01395
2026-03-28 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85b716f9-2140-50f2-bf7c-3d65497f8c80 with identifier: NL01395
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 85b716f9-2140-50f2-bf7c-3d65497f8c80 with identifier: NL01395 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:57:54Z',
 'fuel_type': 'diesel',
 'id': '85b716f9-2140-50f2-bf7c-3d65497f8c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL01395',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 167175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-18',
 'seller_name': None,
 'title': 'Toyota Corolla 2.0 D-4D Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2009}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL01395%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.es] INFO: Saving data for NL01395: {'auction_closing_time': 1774717074.0, 'created_time': 1773127068.211412, 'last_price_update_time': 1774696174.792734}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NL01395') HTTP/1.1" 204 0
2026-03-28 11:09:34 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-28 11:09:34 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ54464%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.es] INFO: Scrape type for MZ54464: 0
2026-03-28 11:09:34 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-28 11:09:34 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN15214%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.es] INFO: Scrape type for WN15214: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 372c0ab9-e5cb-5b30-8c47-b4797032ecf5 with identifier: WN15214
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 372c0ab9-e5cb-5b30-8c47-b4797032ecf5 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 372c0ab9-e5cb-5b30-8c47-b4797032ecf5 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 372c0ab9-e5cb-5b30-8c47-b4797032ecf5, identifier: WN15214
2026-03-28 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 372c0ab9-e5cb-5b30-8c47-b4797032ecf5 with identifier: WN15214
2026-03-28 11:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 372c0ab9-e5cb-5b30-8c47-b4797032ecf5 with identifier: WN15214
2026-03-28 11:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 372c0ab9-e5cb-5b30-8c47-b4797032ecf5 with identifier: WN15214 to the API
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:28:01Z',
 'fuel_type': 'petrol',
 'id': '372c0ab9-e5cb-5b30-8c47-b4797032ecf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN15214',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 122560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-11',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2016}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN15214%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.es] INFO: Saving data for WN15214: {'auction_closing_time': 1774715281.0, 'created_time': 1774296390.203651, 'last_price_update_time': 1774696175.340782}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WN15214') HTTP/1.1" 204 0
2026-03-28 11:09:35 [auto1.es] INFO: Channel: 24h | Page: 59 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:35 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP65825%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.es] INFO: Scrape type for GP65825: 2
2026-03-28 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea325db-cab9-5571-bb5c-fa1e75253e23 with identifier: GP65825
2026-03-28 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea325db-cab9-5571-bb5c-fa1e75253e23 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea325db-cab9-5571-bb5c-fa1e75253e23 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ea325db-cab9-5571-bb5c-fa1e75253e23, identifier: GP65825
2026-03-28 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ea325db-cab9-5571-bb5c-fa1e75253e23 with identifier: GP65825
2026-03-28 11:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ea325db-cab9-5571-bb5c-fa1e75253e23 with identifier: GP65825
2026-03-28 11:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ea325db-cab9-5571-bb5c-fa1e75253e23 with identifier: GP65825 to the API
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:00:32Z',
 'fuel_type': 'diesel',
 'id': '7ea325db-cab9-5571-bb5c-fa1e75253e23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP65825',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 179378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi X-Tech 4x2',
 'transmission': 'manual',
 'trim': 'X-Tech 4x2',
 'year': 2015}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP65825%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.es] INFO: Saving data for GP65825: {'auction_closing_time': 1774713632.0, 'created_time': 1774296479.230011, 'last_price_update_time': 1774696175.746971}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GP65825') HTTP/1.1" 204 0
2026-03-28 11:09:35 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG77720%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.es] INFO: Scrape type for VG77720: 2
2026-03-28 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e678c6cf-f9bb-5087-85da-617da9d97f81 with identifier: VG77720
2026-03-28 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e678c6cf-f9bb-5087-85da-617da9d97f81 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e678c6cf-f9bb-5087-85da-617da9d97f81 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e678c6cf-f9bb-5087-85da-617da9d97f81, identifier: VG77720
2026-03-28 11:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:35 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP85608%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.es] INFO: Scrape type for KP85608: 2
2026-03-28 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecf6555-b508-5b2a-954f-b97108f6e043 with identifier: KP85608
2026-03-28 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecf6555-b508-5b2a-954f-b97108f6e043 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecf6555-b508-5b2a-954f-b97108f6e043 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ecf6555-b508-5b2a-954f-b97108f6e043, identifier: KP85608
2026-03-28 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e678c6cf-f9bb-5087-85da-617da9d97f81 with identifier: VG77720
2026-03-28 11:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e678c6cf-f9bb-5087-85da-617da9d97f81 with identifier: VG77720
2026-03-28 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e678c6cf-f9bb-5087-85da-617da9d97f81 with identifier: VG77720 to the API
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:04Z',
 'fuel_type': 'diesel',
 'id': 'e678c6cf-f9bb-5087-85da-617da9d97f81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG77720',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 329462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-06',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi SE 4x4',
 'transmission': 'manual',
 'trim': 'SE 4x4',
 'year': 2012}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG77720%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.es] INFO: Saving data for VG77720: {'auction_closing_time': 1774715524.0, 'created_time': 1774296375.341241, 'last_price_update_time': 1774696176.278675}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG77720') HTTP/1.1" 204 0
2026-03-28 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ecf6555-b508-5b2a-954f-b97108f6e043 with identifier: KP85608
2026-03-28 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ecf6555-b508-5b2a-954f-b97108f6e043 with identifier: KP85608
2026-03-28 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ecf6555-b508-5b2a-954f-b97108f6e043 with identifier: KP85608 to the API
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:30Z',
 'fuel_type': 'diesel',
 'id': '2ecf6555-b508-5b2a-954f-b97108f6e043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP85608',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 283448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2017}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP85608%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.es] INFO: Saving data for KP85608: {'auction_closing_time': 1774714770.0, 'created_time': 1774296645.353944, 'last_price_update_time': 1774696176.556011}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP85608') HTTP/1.1" 204 0
2026-03-28 11:09:36 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-28 11:09:36 [auto1.es] INFO: Found listing with ID: YV30906
2026-03-28 11:09:36 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL05579%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.es] INFO: Scrape type for DL05579: 2
2026-03-28 11:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242f617f-cd06-58ba-b840-e8e598982f9f with identifier: DL05579
2026-03-28 11:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242f617f-cd06-58ba-b840-e8e598982f9f with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242f617f-cd06-58ba-b840-e8e598982f9f with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 242f617f-cd06-58ba-b840-e8e598982f9f, identifier: DL05579
2026-03-28 11:09:36 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-28 11:09:36 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36544%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.es] INFO: Scrape type for TV36544: 0
2026-03-28 11:09:36 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF92394%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.es] INFO: Scrape type for HF92394: 2
2026-03-28 11:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394
2026-03-28 11:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799a7b95-9920-5f69-9872-3f8ef8d086ae with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 799a7b95-9920-5f69-9872-3f8ef8d086ae with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 799a7b95-9920-5f69-9872-3f8ef8d086ae, identifier: HF92394
2026-03-28 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 242f617f-cd06-58ba-b840-e8e598982f9f with identifier: DL05579
2026-03-28 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 242f617f-cd06-58ba-b840-e8e598982f9f with identifier: DL05579
2026-03-28 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 242f617f-cd06-58ba-b840-e8e598982f9f with identifier: DL05579 to the API
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:04Z',
 'fuel_type': 'petrol',
 'id': '242f617f-cd06-58ba-b840-e8e598982f9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL05579',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 89307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL05579%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.es] INFO: Saving data for DL05579: {'auction_closing_time': 1774715884.0, 'created_time': 1774296601.225323, 'last_price_update_time': 1774696177.077739}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL05579') HTTP/1.1" 204 0
2026-03-28 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394
2026-03-28 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394
2026-03-28 11:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394 to the API
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:58Z',
 'fuel_type': 'diesel',
 'id': '799a7b95-9920-5f69-9872-3f8ef8d086ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF92394',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 252876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI clean diesel quattro Advanced edition',
 'transmission': 'manual',
 'trim': 'quattro Advanced edition',
 'year': 2015}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF92394%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.es] INFO: Saving data for HF92394: {'auction_closing_time': 1774715218.0, 'created_time': 1773132873.242922, 'last_price_update_time': 1774696177.450449}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF92394') HTTP/1.1" 204 0
2026-03-28 11:09:37 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK08613%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.es] INFO: Scrape type for UK08613: 2
2026-03-28 11:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613
2026-03-28 11:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df78b7bb-7b41-549f-bac2-339816bc3a19 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df78b7bb-7b41-549f-bac2-339816bc3a19 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: df78b7bb-7b41-549f-bac2-339816bc3a19, identifier: UK08613
2026-03-28 11:09:37 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS08117%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.es] INFO: Scrape type for AS08117: 0
2026-03-28 11:09:37 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-28 11:09:37 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN45249%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.es] INFO: Scrape type for XN45249: 2
2026-03-28 11:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde5fdd1-b49a-50c5-98c2-a01e692dee13 with identifier: XN45249
2026-03-28 11:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde5fdd1-b49a-50c5-98c2-a01e692dee13 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde5fdd1-b49a-50c5-98c2-a01e692dee13 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cde5fdd1-b49a-50c5-98c2-a01e692dee13, identifier: XN45249
2026-03-28 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613
2026-03-28 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613
2026-03-28 11:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613 to the API
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:14:15Z',
 'fuel_type': 'diesel',
 'id': 'df78b7bb-7b41-549f-bac2-339816bc3a19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK08613',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 142187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-08',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style I-Tech',
 'transmission': 'automatic',
 'trim': 'Style I-Tech',
 'year': 2015}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK08613%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.es] INFO: Saving data for UK08613: {'auction_closing_time': 1774714455.0, 'created_time': 1773131713.10247, 'last_price_update_time': 1774696177.970934}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UK08613') HTTP/1.1" 204 0
2026-03-28 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cde5fdd1-b49a-50c5-98c2-a01e692dee13 with identifier: XN45249
2026-03-28 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cde5fdd1-b49a-50c5-98c2-a01e692dee13 with identifier: XN45249
2026-03-28 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cde5fdd1-b49a-50c5-98c2-a01e692dee13 with identifier: XN45249 to the API
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:11:34Z',
 'fuel_type': 'diesel',
 'id': 'cde5fdd1-b49a-50c5-98c2-a01e692dee13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN45249',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 204349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-27',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Furgón',
 'transmission': 'manual',
 'trim': 'Furgón',
 'year': 2020}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN45249%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.es] INFO: Saving data for XN45249: {'auction_closing_time': 1774714294.0, 'created_time': 1773691578.488373, 'last_price_update_time': 1774696178.247717}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN45249') HTTP/1.1" 204 0
2026-03-28 11:09:38 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-28 11:09:38 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV24986%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.es] INFO: Scrape type for EV24986: 2
2026-03-28 11:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce418c6-d941-5583-9ba6-c146f0a8fe5e with identifier: EV24986
2026-03-28 11:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce418c6-d941-5583-9ba6-c146f0a8fe5e with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce418c6-d941-5583-9ba6-c146f0a8fe5e with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cce418c6-d941-5583-9ba6-c146f0a8fe5e, identifier: EV24986
2026-03-28 11:09:38 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-28 11:09:38 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ02297%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.es] INFO: Scrape type for HZ02297: 0
2026-03-28 11:09:38 [auto1.es] INFO: Found listing with ID: UG78525
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG78525%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.es] INFO: Scrape type for UG78525: 2
2026-03-28 11:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89be4df1-02c0-5336-9e0f-c7c884530d43 with identifier: UG78525
2026-03-28 11:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89be4df1-02c0-5336-9e0f-c7c884530d43 with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89be4df1-02c0-5336-9e0f-c7c884530d43 with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 89be4df1-02c0-5336-9e0f-c7c884530d43, identifier: UG78525
2026-03-28 11:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cce418c6-d941-5583-9ba6-c146f0a8fe5e with identifier: EV24986
2026-03-28 11:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cce418c6-d941-5583-9ba6-c146f0a8fe5e with identifier: EV24986
2026-03-28 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cce418c6-d941-5583-9ba6-c146f0a8fe5e with identifier: EV24986 to the API
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:20Z',
 'fuel_type': 'diesel',
 'id': 'cce418c6-d941-5583-9ba6-c146f0a8fe5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV24986',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 129869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.9 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV24986%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.es] INFO: Saving data for EV24986: {'auction_closing_time': 1774716740.0, 'created_time': 1774296569.715808, 'last_price_update_time': 1774696178.795521}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EV24986') HTTP/1.1" 204 0
2026-03-28 11:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 89be4df1-02c0-5336-9e0f-c7c884530d43 with identifier: UG78525
2026-03-28 11:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 89be4df1-02c0-5336-9e0f-c7c884530d43 with identifier: UG78525
2026-03-28 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 89be4df1-02c0-5336-9e0f-c7c884530d43 with identifier: UG78525 to the API
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-28T16:23:02Z',
 'fuel_type': 'hybrid',
 'id': '89be4df1-02c0-5336-9e0f-c7c884530d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG78525',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 51534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Kaiteki+ 4WD',
 'transmission': 'automatic',
 'trim': 'Kaiteki+ 4WD',
 'year': 2022}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG78525%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.es] INFO: Saving data for UG78525: {'auction_closing_time': 1774714982.0, 'created_time': 1774296643.601667, 'last_price_update_time': 1774696179.115836}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG78525') HTTP/1.1" 204 0
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK55405%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.es] INFO: Scrape type for RK55405: 2
2026-03-28 11:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4dc868d-9f4c-57c9-8487-da07127976bd with identifier: RK55405
2026-03-28 11:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4dc868d-9f4c-57c9-8487-da07127976bd with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4dc868d-9f4c-57c9-8487-da07127976bd with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4dc868d-9f4c-57c9-8487-da07127976bd, identifier: RK55405
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK07555%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.es] INFO: Scrape type for LK07555: 0
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-28 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4dc868d-9f4c-57c9-8487-da07127976bd with identifier: RK55405
2026-03-28 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4dc868d-9f4c-57c9-8487-da07127976bd with identifier: RK55405
2026-03-28 11:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4dc868d-9f4c-57c9-8487-da07127976bd with identifier: RK55405 to the API
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:06:55Z',
 'fuel_type': 'petrol',
 'id': 'b4dc868d-9f4c-57c9-8487-da07127976bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK55405',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 149651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference Plus',
 'transmission': 'manual',
 'trim': 'Reference Plus',
 'year': 2016}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK55405%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.es] INFO: Saving data for RK55405: {'auction_closing_time': 1774714015.0, 'created_time': 1773132596.364442, 'last_price_update_time': 1774696179.536181}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK55405') HTTP/1.1" 204 0
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG21171%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.es] INFO: Scrape type for UG21171: 0
2026-03-28 11:09:39 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME07403%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.es] INFO: Scrape type for ME07403: 2
2026-03-28 11:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fda023-25b9-5aa1-90f7-38632d329825 with identifier: ME07403
2026-03-28 11:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fda023-25b9-5aa1-90f7-38632d329825 with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30fda023-25b9-5aa1-90f7-38632d329825 with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30fda023-25b9-5aa1-90f7-38632d329825, identifier: ME07403
2026-03-28 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30fda023-25b9-5aa1-90f7-38632d329825 with identifier: ME07403
2026-03-28 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30fda023-25b9-5aa1-90f7-38632d329825 with identifier: ME07403
2026-03-28 11:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30fda023-25b9-5aa1-90f7-38632d329825 with identifier: ME07403 to the API
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:07:39Z',
 'fuel_type': 'petrol',
 'id': '30fda023-25b9-5aa1-90f7-38632d329825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME07403',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 60852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-12',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2011}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME07403%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Saving data for ME07403: {'auction_closing_time': 1774714059.0, 'created_time': 1773346246.116332, 'last_price_update_time': 1774696180.025423}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ME07403') HTTP/1.1" 204 0
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF36359%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Scrape type for MF36359: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05da4e44-6056-59e0-bc97-4dbf7a3c2774 with identifier: MF36359
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05da4e44-6056-59e0-bc97-4dbf7a3c2774 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05da4e44-6056-59e0-bc97-4dbf7a3c2774 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05da4e44-6056-59e0-bc97-4dbf7a3c2774, identifier: MF36359
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05da4e44-6056-59e0-bc97-4dbf7a3c2774 with identifier: MF36359
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05da4e44-6056-59e0-bc97-4dbf7a3c2774 with identifier: MF36359
2026-03-28 11:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05da4e44-6056-59e0-bc97-4dbf7a3c2774 with identifier: MF36359 to the API
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:03:31Z',
 'fuel_type': 'petrol',
 'id': '05da4e44-6056-59e0-bc97-4dbf7a3c2774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF36359',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 196965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-02',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2004}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF36359%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Saving data for MF36359: {'auction_closing_time': 1774713811.0, 'created_time': 1774102069.72079, 'last_price_update_time': 1774696180.404457}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MF36359') HTTP/1.1" 204 0
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP01859%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Scrape type for HP01859: 0
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP49442%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Scrape type for CP49442: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3befaa6b-ccba-5461-b49e-12b6f50e81e9 with identifier: CP49442
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3befaa6b-ccba-5461-b49e-12b6f50e81e9 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3befaa6b-ccba-5461-b49e-12b6f50e81e9 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3befaa6b-ccba-5461-b49e-12b6f50e81e9, identifier: CP49442
2026-03-28 11:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3befaa6b-ccba-5461-b49e-12b6f50e81e9 with identifier: CP49442
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3befaa6b-ccba-5461-b49e-12b6f50e81e9 with identifier: CP49442
2026-03-28 11:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3befaa6b-ccba-5461-b49e-12b6f50e81e9 with identifier: CP49442 to the API
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:03:14Z',
 'fuel_type': 'diesel',
 'id': '3befaa6b-ccba-5461-b49e-12b6f50e81e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP49442',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 195690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-17',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP49442%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Saving data for CP49442: {'auction_closing_time': 1774713794.0, 'created_time': 1773130410.090939, 'last_price_update_time': 1774696180.820836}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP49442') HTTP/1.1" 204 0
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-28 11:09:40 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY31603%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.es] INFO: Scrape type for VY31603: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e8f1d8-f774-515b-a507-9f924db61ad2 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e8f1d8-f774-515b-a507-9f924db61ad2 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7e8f1d8-f774-515b-a507-9f924db61ad2, identifier: VY31603
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:15:13Z',
 'fuel_type': 'diesel',
 'id': 'e7e8f1d8-f774-515b-a507-9f924db61ad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY31603',
 'listing': 'auction',
 'make': 'Isuzu',
 'model': 'D-MAX',
 'odometer': 47591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-31',
 'seller_name': None,
 'title': 'Isuzu D-MAX 1.9 Turbodiesel Space Cab 4WD L',
 'transmission': 'manual',
 'trim': 'Space Cab 4WD L',
 'year': 2023}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY31603%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.es] INFO: Saving data for VY31603: {'auction_closing_time': 1774714513.0, 'created_time': 1773131100.743658, 'last_price_update_time': 1774696181.225644}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY31603') HTTP/1.1" 204 0
2026-03-28 11:09:41 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-28 11:09:41 [auto1.es] INFO: Found listing with ID: TG12231
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG12231%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.es] INFO: Scrape type for TG12231: 2
2026-03-28 11:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 122f2648-051f-556d-8771-5b68db858949 with identifier: TG12231
2026-03-28 11:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 122f2648-051f-556d-8771-5b68db858949 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 122f2648-051f-556d-8771-5b68db858949 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 122f2648-051f-556d-8771-5b68db858949, identifier: TG12231
2026-03-28 11:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 122f2648-051f-556d-8771-5b68db858949 with identifier: TG12231
2026-03-28 11:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 122f2648-051f-556d-8771-5b68db858949 with identifier: TG12231
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 122f2648-051f-556d-8771-5b68db858949 with identifier: TG12231 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:06:22Z',
 'fuel_type': 'petrol',
 'id': '122f2648-051f-556d-8771-5b68db858949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG12231',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 264606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-30',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2007}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG12231%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.es] INFO: Saving data for TG12231: {'auction_closing_time': 1774713982.0, 'created_time': 1774091181.54546, 'last_price_update_time': 1774696181.687777}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG12231') HTTP/1.1" 204 0
2026-03-28 11:09:41 [auto1.es] INFO: Channel: 24h | Page: 60 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:41 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-28 11:09:41 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ67299%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.es] INFO: Scrape type for ZJ67299: 2
2026-03-28 11:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ea6419-dcfd-5850-bd81-64dcc018ce84 with identifier: ZJ67299
2026-03-28 11:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ea6419-dcfd-5850-bd81-64dcc018ce84 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ea6419-dcfd-5850-bd81-64dcc018ce84 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0ea6419-dcfd-5850-bd81-64dcc018ce84, identifier: ZJ67299
2026-03-28 11:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0ea6419-dcfd-5850-bd81-64dcc018ce84 with identifier: ZJ67299
2026-03-28 11:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0ea6419-dcfd-5850-bd81-64dcc018ce84 with identifier: ZJ67299
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c0ea6419-dcfd-5850-bd81-64dcc018ce84 with identifier: ZJ67299 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:26Z',
 'fuel_type': 'diesel',
 'id': 'c0ea6419-dcfd-5850-bd81-64dcc018ce84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ67299',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 262588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ67299%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.es] INFO: Saving data for ZJ67299: {'auction_closing_time': 1774717106.0, 'created_time': 1773130895.018905, 'last_price_update_time': 1774696182.076718}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ67299') HTTP/1.1" 204 0
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ44927%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.es] INFO: Scrape type for WZ44927: 2
2026-03-28 11:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927
2026-03-28 11:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75796c2c-b11f-5aaf-9668-fc8f5feeab52, identifier: WZ44927
2026-03-28 11:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: GR19122
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ21450%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.es] INFO: Scrape type for BZ21450: 0
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-28 11:09:42 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE42254%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.es] INFO: Scrape type for HE42254: 2
2026-03-28 11:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254
2026-03-28 11:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e997dbe8-3316-5a84-ba7f-f81f60660100 with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e997dbe8-3316-5a84-ba7f-f81f60660100 with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e997dbe8-3316-5a84-ba7f-f81f60660100, identifier: HE42254
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927
2026-03-28 11:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927 to the API
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-28T16:50:32Z',
 'fuel_type': 'petrol',
 'id': '75796c2c-b11f-5aaf-9668-fc8f5feeab52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ44927',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 210267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-07',
 'seller_name': None,
 'title': 'Toyota Verso 1.8 Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2017}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ44927%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.es] INFO: Saving data for WZ44927: {'auction_closing_time': 1774716632.0, 'created_time': 1773129681.995576, 'last_price_update_time': 1774696182.63704}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ44927') HTTP/1.1" 204 0
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254
2026-03-28 11:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254 to the API
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:16Z',
 'fuel_type': 'petrol',
 'id': 'e997dbe8-3316-5a84-ba7f-f81f60660100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE42254',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 31461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Audi A1 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2020}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE42254%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Saving data for HE42254: {'auction_closing_time': 1774715896.0, 'created_time': 1774274960.253114, 'last_price_update_time': 1774696183.029446}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HE42254') HTTP/1.1" 204 0
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM84841%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Scrape type for DM84841: 0
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH50359%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Scrape type for DH50359: 0
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ73279%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Scrape type for NJ73279: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08640767-4910-5498-926e-158541284fda with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08640767-4910-5498-926e-158541284fda with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08640767-4910-5498-926e-158541284fda, identifier: NJ73279
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK09701%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Scrape type for RK09701: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f1cd8f-d828-5aa5-9076-a40bb2603ccf with identifier: RK09701
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f1cd8f-d828-5aa5-9076-a40bb2603ccf with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f1cd8f-d828-5aa5-9076-a40bb2603ccf with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8f1cd8f-d828-5aa5-9076-a40bb2603ccf, identifier: RK09701
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:16:42Z',
 'fuel_type': 'petrol',
 'id': '08640767-4910-5498-926e-158541284fda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ73279',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 49606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2018}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ73279%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Saving data for NJ73279: {'auction_closing_time': 1774714602.0, 'created_time': 1773126963.216477, 'last_price_update_time': 1774696183.567692}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ73279') HTTP/1.1" 204 0
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8f1cd8f-d828-5aa5-9076-a40bb2603ccf with identifier: RK09701
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8f1cd8f-d828-5aa5-9076-a40bb2603ccf with identifier: RK09701
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8f1cd8f-d828-5aa5-9076-a40bb2603ccf with identifier: RK09701 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:04:22Z',
 'fuel_type': 'petrol',
 'id': 'e8f1cd8f-d828-5aa5-9076-a40bb2603ccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK09701',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 121406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-12',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK09701%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Saving data for RK09701: {'auction_closing_time': 1774713862.0, 'created_time': 1773745653.844714, 'last_price_update_time': 1774696183.84104}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK09701') HTTP/1.1" 204 0
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM08675%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Scrape type for GM08675: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b84e3b-9331-5afa-9b5e-be28c7a390c5 with identifier: GM08675
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b84e3b-9331-5afa-9b5e-be28c7a390c5 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5b84e3b-9331-5afa-9b5e-be28c7a390c5 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5b84e3b-9331-5afa-9b5e-be28c7a390c5, identifier: GM08675
2026-03-28 11:09:43 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36726%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.es] INFO: Scrape type for TV36726: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d8a104b-1909-5021-a436-6b9b266512fa with identifier: TV36726
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8a104b-1909-5021-a436-6b9b266512fa with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d8a104b-1909-5021-a436-6b9b266512fa with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d8a104b-1909-5021-a436-6b9b266512fa, identifier: TV36726
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5b84e3b-9331-5afa-9b5e-be28c7a390c5 with identifier: GM08675
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5b84e3b-9331-5afa-9b5e-be28c7a390c5 with identifier: GM08675
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c5b84e3b-9331-5afa-9b5e-be28c7a390c5 with identifier: GM08675 to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:43:13Z',
 'fuel_type': 'hybrid',
 'id': 'c5b84e3b-9331-5afa-9b5e-be28c7a390c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM08675',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 146988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Renault Captur 1.6 E-Tech Hybrid Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2020}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM08675%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.es] INFO: Saving data for GM08675: {'auction_closing_time': 1774716193.0, 'created_time': 1773131956.491453, 'last_price_update_time': 1774696184.324379}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GM08675') HTTP/1.1" 204 0
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d8a104b-1909-5021-a436-6b9b266512fa with identifier: TV36726
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d8a104b-1909-5021-a436-6b9b266512fa with identifier: TV36726
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d8a104b-1909-5021-a436-6b9b266512fa with identifier: TV36726 to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:16Z',
 'fuel_type': 'diesel',
 'id': '0d8a104b-1909-5021-a436-6b9b266512fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV36726',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 201883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-30',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Sport Plus',
 'transmission': 'automatic',
 'trim': 'Sport Plus',
 'year': 2007}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36726%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.es] INFO: Saving data for TV36726: {'auction_closing_time': 1774716976.0, 'created_time': 1773133925.013118, 'last_price_update_time': 1774696184.596912}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV36726') HTTP/1.1" 204 0
2026-03-28 11:09:44 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-28 11:09:44 [auto1.es] INFO: Found listing with ID: XX72262
2026-03-28 11:09:44 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-28 11:09:44 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG94479%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.es] INFO: Scrape type for LG94479: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9061b786-b3d5-590a-a274-a01e9e2ca649 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9061b786-b3d5-590a-a274-a01e9e2ca649 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9061b786-b3d5-590a-a274-a01e9e2ca649, identifier: LG94479
2026-03-28 11:09:44 [auto1.es] INFO: Found listing with ID: GE62108
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE62108%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.es] INFO: Scrape type for GE62108: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6 with identifier: GE62108
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6, identifier: GE62108
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479 to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:38:49Z',
 'fuel_type': 'petrol',
 'id': '9061b786-b3d5-590a-a274-a01e9e2ca649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG94479',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 70494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe SL Xplore',
 'transmission': 'manual',
 'trim': 'SL Xplore',
 'year': 2020}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG94479%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.es] INFO: Saving data for LG94479: {'auction_closing_time': 1774715929.0, 'created_time': 1773131430.718094, 'last_price_update_time': 1774696185.128515}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LG94479') HTTP/1.1" 204 0
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6 with identifier: GE62108
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6 with identifier: GE62108
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6 with identifier: GE62108 to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:08Z',
 'fuel_type': 'diesel',
 'id': 'f7ca2e84-fdcf-53e8-aa0d-d222e7ef6ca6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE62108',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 174987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-01',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE62108%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.es] INFO: Saving data for GE62108: {'auction_closing_time': 1774715168.0, 'created_time': 1773129230.684654, 'last_price_update_time': 1774696185.519675}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GE62108') HTTP/1.1" 204 0
2026-03-28 11:09:45 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-28 11:09:45 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-28 11:09:45 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-28 11:09:45 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP83247%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.es] INFO: Scrape type for KP83247: 2
2026-03-28 11:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 020987bc-221e-53bd-a6da-939ad4a222a3 with identifier: KP83247
2026-03-28 11:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 020987bc-221e-53bd-a6da-939ad4a222a3 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 020987bc-221e-53bd-a6da-939ad4a222a3 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 020987bc-221e-53bd-a6da-939ad4a222a3, identifier: KP83247
2026-03-28 11:09:45 [auto1.es] INFO: Found listing with ID: ZH45296
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH45296%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.es] INFO: Scrape type for ZH45296: 2
2026-03-28 11:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf621ea-fa8c-51c7-a67f-6bece0fa736b with identifier: ZH45296
2026-03-28 11:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf621ea-fa8c-51c7-a67f-6bece0fa736b with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccf621ea-fa8c-51c7-a67f-6bece0fa736b with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ccf621ea-fa8c-51c7-a67f-6bece0fa736b, identifier: ZH45296
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 020987bc-221e-53bd-a6da-939ad4a222a3 with identifier: KP83247
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 020987bc-221e-53bd-a6da-939ad4a222a3 with identifier: KP83247
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 020987bc-221e-53bd-a6da-939ad4a222a3 with identifier: KP83247 to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:23Z',
 'fuel_type': 'diesel',
 'id': '020987bc-221e-53bd-a6da-939ad4a222a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP83247',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 218128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-04',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2008}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP83247%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.es] INFO: Saving data for KP83247: {'auction_closing_time': 1774716203.0, 'created_time': 1773131928.318464, 'last_price_update_time': 1774696186.061549}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP83247') HTTP/1.1" 204 0
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ccf621ea-fa8c-51c7-a67f-6bece0fa736b with identifier: ZH45296
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ccf621ea-fa8c-51c7-a67f-6bece0fa736b with identifier: ZH45296
2026-03-28 11:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ccf621ea-fa8c-51c7-a67f-6bece0fa736b with identifier: ZH45296 to the API
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:10:42Z',
 'fuel_type': 'diesel',
 'id': 'ccf621ea-fa8c-51c7-a67f-6bece0fa736b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH45296',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 209345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-12',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2013}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH45296%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.es] INFO: Saving data for ZH45296: {'auction_closing_time': 1774714242.0, 'created_time': 1773843363.650619, 'last_price_update_time': 1774696186.34253}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH45296') HTTP/1.1" 204 0
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN11800%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.es] INFO: Scrape type for HN11800: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5845da78-a5cb-5628-bdde-70d88537b87e with identifier: HN11800
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5845da78-a5cb-5628-bdde-70d88537b87e with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5845da78-a5cb-5628-bdde-70d88537b87e with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5845da78-a5cb-5628-bdde-70d88537b87e, identifier: HN11800
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5845da78-a5cb-5628-bdde-70d88537b87e with identifier: HN11800
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5845da78-a5cb-5628-bdde-70d88537b87e with identifier: HN11800
2026-03-28 11:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5845da78-a5cb-5628-bdde-70d88537b87e with identifier: HN11800 to the API
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:29:31Z',
 'fuel_type': 'diesel',
 'id': '5845da78-a5cb-5628-bdde-70d88537b87e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN11800',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 147220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-14',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2019}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN11800%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.es] INFO: Saving data for HN11800: {'auction_closing_time': 1774715371.0, 'created_time': 1772623105.543009, 'last_price_update_time': 1774696186.750831}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HN11800') HTTP/1.1" 204 0
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: GH42664
2026-03-28 11:09:46 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV08458%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.es] INFO: Scrape type for UV08458: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12341387-381c-59b7-9079-66df079630e5 with identifier: UV08458
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12341387-381c-59b7-9079-66df079630e5 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12341387-381c-59b7-9079-66df079630e5 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12341387-381c-59b7-9079-66df079630e5, identifier: UV08458
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12341387-381c-59b7-9079-66df079630e5 with identifier: UV08458
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12341387-381c-59b7-9079-66df079630e5 with identifier: UV08458
2026-03-28 11:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 12341387-381c-59b7-9079-66df079630e5 with identifier: UV08458 to the API
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:59Z',
 'fuel_type': 'diesel',
 'id': '12341387-381c-59b7-9079-66df079630e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV08458',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 11925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-29',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi',
 'transmission': 'automatic',
 'trim': 'Maxi',
 'year': 2025}
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV08458%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [auto1.es] INFO: Saving data for UV08458: {'auction_closing_time': 1774717079.0, 'created_time': 1773128143.39955, 'last_price_update_time': 1774696187.16472}
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UV08458') HTTP/1.1" 204 0
2026-03-28 11:09:47 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-28 11:09:47 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-28 11:09:47 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-28 11:09:47 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-28 11:09:47 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-28 11:09:47 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP39110%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [auto1.es] INFO: Scrape type for PP39110: 2
2026-03-28 11:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d20f7bda-6f60-5aae-b80f-36cc562619c3 with identifier: PP39110
2026-03-28 11:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d20f7bda-6f60-5aae-b80f-36cc562619c3 with scrape type 2
2026-03-28 11:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d20f7bda-6f60-5aae-b80f-36cc562619c3 with scrape type 2
2026-03-28 11:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d20f7bda-6f60-5aae-b80f-36cc562619c3, identifier: PP39110
2026-03-28 11:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d20f7bda-6f60-5aae-b80f-36cc562619c3 with identifier: PP39110
2026-03-28 11:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d20f7bda-6f60-5aae-b80f-36cc562619c3 with identifier: PP39110
2026-03-28 11:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d20f7bda-6f60-5aae-b80f-36cc562619c3 with identifier: PP39110 to the API
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:08Z',
 'fuel_type': 'diesel',
 'id': 'd20f7bda-6f60-5aae-b80f-36cc562619c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP39110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 45125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-21',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP39110%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.es] INFO: Saving data for PP39110: {'auction_closing_time': 1774716188.0, 'created_time': 1773324323.261032, 'last_price_update_time': 1774696188.104737}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PP39110') HTTP/1.1" 204 0
2026-03-28 11:09:48 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT72287%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.es] INFO: Scrape type for TT72287: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2bc70bb-589f-54ed-8cb5-71006bdc0824 with identifier: TT72287
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2bc70bb-589f-54ed-8cb5-71006bdc0824 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2bc70bb-589f-54ed-8cb5-71006bdc0824 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2bc70bb-589f-54ed-8cb5-71006bdc0824, identifier: TT72287
2026-03-28 11:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2bc70bb-589f-54ed-8cb5-71006bdc0824 with identifier: TT72287
2026-03-28 11:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2bc70bb-589f-54ed-8cb5-71006bdc0824 with identifier: TT72287
2026-03-28 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2bc70bb-589f-54ed-8cb5-71006bdc0824 with identifier: TT72287 to the API
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:08:06Z',
 'fuel_type': 'diesel',
 'id': 'a2bc70bb-589f-54ed-8cb5-71006bdc0824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT72287',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 353351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-14',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT72287%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.es] INFO: Saving data for TT72287: {'auction_closing_time': 1774714086.0, 'created_time': 1773864728.278433, 'last_price_update_time': 1774696188.504018}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TT72287') HTTP/1.1" 204 0
2026-03-28 11:09:48 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-28 11:09:48 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-28 11:09:48 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK23766%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.es] INFO: Scrape type for MK23766: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64 with identifier: MK23766
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64, identifier: MK23766
2026-03-28 11:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64 with identifier: MK23766
2026-03-28 11:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64 with identifier: MK23766
2026-03-28 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64 with identifier: MK23766 to the API
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:12:56Z',
 'fuel_type': 'diesel',
 'id': '8f63e3a8-e0e8-5ae1-b93e-aec12e0d7d64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK23766',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 296985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-18',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK23766%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.es] INFO: Saving data for MK23766: {'auction_closing_time': 1774714376.0, 'created_time': 1773691532.373873, 'last_price_update_time': 1774696188.890984}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MK23766') HTTP/1.1" 204 0
2026-03-28 11:09:48 [auto1.es] INFO: Found listing with ID: DR64033
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR64033%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.es] INFO: Scrape type for DR64033: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b991b35-11ca-510b-93d2-0c5b858d42d2 with identifier: DR64033
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b991b35-11ca-510b-93d2-0c5b858d42d2 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b991b35-11ca-510b-93d2-0c5b858d42d2 with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b991b35-11ca-510b-93d2-0c5b858d42d2, identifier: DR64033
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b991b35-11ca-510b-93d2-0c5b858d42d2 with identifier: DR64033
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b991b35-11ca-510b-93d2-0c5b858d42d2 with identifier: DR64033
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b991b35-11ca-510b-93d2-0c5b858d42d2 with identifier: DR64033 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:26:14Z',
 'fuel_type': 'petrol',
 'id': '9b991b35-11ca-510b-93d2-0c5b858d42d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR64033',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 154306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-13',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style I-Tech 30 Aniversario',
 'transmission': 'automatic',
 'trim': 'Style I-Tech 30 Aniversario',
 'year': 2014}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR64033%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.es] INFO: Saving data for DR64033: {'auction_closing_time': 1774715174.0, 'created_time': 1772623259.61121, 'last_price_update_time': 1774696189.271097}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DR64033') HTTP/1.1" 204 0
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD86662%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.es] INFO: Scrape type for PD86662: 0
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT66217%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.es] INFO: Scrape type for NT66217: 2
2026-03-28 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10d6bece-c385-5ea7-8f6f-1c392353f2ed with identifier: NT66217
2026-03-28 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10d6bece-c385-5ea7-8f6f-1c392353f2ed with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10d6bece-c385-5ea7-8f6f-1c392353f2ed with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10d6bece-c385-5ea7-8f6f-1c392353f2ed, identifier: NT66217
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10d6bece-c385-5ea7-8f6f-1c392353f2ed with identifier: NT66217
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10d6bece-c385-5ea7-8f6f-1c392353f2ed with identifier: NT66217
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10d6bece-c385-5ea7-8f6f-1c392353f2ed with identifier: NT66217 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:50:03Z',
 'fuel_type': 'diesel',
 'id': '10d6bece-c385-5ea7-8f6f-1c392353f2ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT66217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 258563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2002}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT66217%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.es] INFO: Saving data for NT66217: {'auction_closing_time': 1774716603.0, 'created_time': 1774296623.408046, 'last_price_update_time': 1774696189.77156}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NT66217') HTTP/1.1" 204 0
2026-03-28 11:09:49 [auto1.es] INFO: Channel: 24h | Page: 61 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-28 11:09:49 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG55573%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.es] INFO: Scrape type for BG55573: 2
2026-03-28 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9c44e7-126f-5dcd-ad4e-1622467a64fc with identifier: BG55573
2026-03-28 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9c44e7-126f-5dcd-ad4e-1622467a64fc with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9c44e7-126f-5dcd-ad4e-1622467a64fc with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d9c44e7-126f-5dcd-ad4e-1622467a64fc, identifier: BG55573
2026-03-28 11:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d9c44e7-126f-5dcd-ad4e-1622467a64fc with identifier: BG55573
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d9c44e7-126f-5dcd-ad4e-1622467a64fc with identifier: BG55573
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d9c44e7-126f-5dcd-ad4e-1622467a64fc with identifier: BG55573 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:58Z',
 'fuel_type': 'diesel',
 'id': '8d9c44e7-126f-5dcd-ad4e-1622467a64fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG55573',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 209248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2005}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG55573%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.es] INFO: Saving data for BG55573: {'auction_closing_time': 1774716178.0, 'created_time': 1773130604.217075, 'last_price_update_time': 1774696190.170576}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG55573') HTTP/1.1" 204 0
2026-03-28 11:09:50 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT91769%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.es] INFO: Scrape type for CT91769: 2
2026-03-28 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769
2026-03-28 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8a1c3d5-2cc3-5787-bf85-5046b385ef53, identifier: CT91769
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769
2026-03-28 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769
2026-03-28 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769 to the API
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:05:28Z',
 'fuel_type': 'diesel',
 'id': 'c8a1c3d5-2cc3-5787-bf85-5046b385ef53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT91769',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 264811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-20',
 'seller_name': None,
 'title': 'BMW 3er 318d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT91769%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.es] INFO: Saving data for CT91769: {'auction_closing_time': 1774713928.0, 'created_time': 1773133924.299955, 'last_price_update_time': 1774696190.58419}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT91769') HTTP/1.1" 204 0
2026-03-28 11:09:50 [auto1.es] INFO: Found listing with ID: UV80286
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV80286%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.es] INFO: Scrape type for UV80286: 2
2026-03-28 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e995fdd7-545e-53c1-a110-c95363b8c526 with identifier: UV80286
2026-03-28 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e995fdd7-545e-53c1-a110-c95363b8c526 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e995fdd7-545e-53c1-a110-c95363b8c526 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e995fdd7-545e-53c1-a110-c95363b8c526, identifier: UV80286
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e995fdd7-545e-53c1-a110-c95363b8c526 with identifier: UV80286
2026-03-28 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e995fdd7-545e-53c1-a110-c95363b8c526 with identifier: UV80286
2026-03-28 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e995fdd7-545e-53c1-a110-c95363b8c526 with identifier: UV80286 to the API
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:08Z',
 'fuel_type': 'diesel',
 'id': 'e995fdd7-545e-53c1-a110-c95363b8c526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV80286',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 192290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV80286%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Saving data for UV80286: {'auction_closing_time': 1774714808.0, 'created_time': 1774609657.61908, 'last_price_update_time': 1774696191.07153}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UV80286') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP83421%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Scrape type for RP83421: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76a81cf-f320-5deb-b496-c633be51b155 with identifier: RP83421
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76a81cf-f320-5deb-b496-c633be51b155 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f76a81cf-f320-5deb-b496-c633be51b155 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f76a81cf-f320-5deb-b496-c633be51b155, identifier: RP83421
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f76a81cf-f320-5deb-b496-c633be51b155 with identifier: RP83421
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f76a81cf-f320-5deb-b496-c633be51b155 with identifier: RP83421
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f76a81cf-f320-5deb-b496-c633be51b155 with identifier: RP83421 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:49:08Z',
 'fuel_type': 'petrol',
 'id': 'f76a81cf-f320-5deb-b496-c633be51b155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP83421',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 37996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP83421%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Saving data for RP83421: {'auction_closing_time': 1774716548.0, 'created_time': 1773129717.271983, 'last_price_update_time': 1774696191.459863}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RP83421') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.es] INFO: Found listing with ID: YE20956
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE20956%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Scrape type for YE20956: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0384e703-8d11-5943-b758-00e6e5c22f04 with identifier: YE20956
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0384e703-8d11-5943-b758-00e6e5c22f04 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0384e703-8d11-5943-b758-00e6e5c22f04 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0384e703-8d11-5943-b758-00e6e5c22f04, identifier: YE20956
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0384e703-8d11-5943-b758-00e6e5c22f04 with identifier: YE20956
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0384e703-8d11-5943-b758-00e6e5c22f04 with identifier: YE20956
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0384e703-8d11-5943-b758-00e6e5c22f04 with identifier: YE20956 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:19:57Z',
 'fuel_type': 'diesel',
 'id': '0384e703-8d11-5943-b758-00e6e5c22f04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE20956',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 99062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Sport BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion Tech',
 'year': 2016}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE20956%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Saving data for YE20956: {'auction_closing_time': 1774714797.0, 'created_time': 1774296635.173503, 'last_price_update_time': 1774696191.817395}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YE20956') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT33215%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Scrape type for FT33215: 0
2026-03-28 11:09:51 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB32241%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.es] INFO: Scrape type for CB32241: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c84e36-f75f-5e45-a24b-cfbd183439bd with identifier: CB32241
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c84e36-f75f-5e45-a24b-cfbd183439bd with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c84e36-f75f-5e45-a24b-cfbd183439bd with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83c84e36-f75f-5e45-a24b-cfbd183439bd, identifier: CB32241
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83c84e36-f75f-5e45-a24b-cfbd183439bd with identifier: CB32241
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83c84e36-f75f-5e45-a24b-cfbd183439bd with identifier: CB32241
2026-03-28 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83c84e36-f75f-5e45-a24b-cfbd183439bd with identifier: CB32241 to the API
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:25:31Z',
 'fuel_type': 'diesel',
 'id': '83c84e36-f75f-5e45-a24b-cfbd183439bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB32241',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 232306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-27',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi VTR Plus',
 'transmission': 'manual',
 'trim': 'VTR Plus',
 'year': 2006}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB32241%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.es] INFO: Saving data for CB32241: {'auction_closing_time': 1774715131.0, 'created_time': 1773129495.971513, 'last_price_update_time': 1774696192.218122}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CB32241') HTTP/1.1" 204 0
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD21728%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.es] INFO: Scrape type for PD21728: 2
2026-03-28 11:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef969f1c-0d74-5cad-84ce-4ebf9e1366cb with identifier: PD21728
2026-03-28 11:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef969f1c-0d74-5cad-84ce-4ebf9e1366cb with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef969f1c-0d74-5cad-84ce-4ebf9e1366cb with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef969f1c-0d74-5cad-84ce-4ebf9e1366cb, identifier: PD21728
2026-03-28 11:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef969f1c-0d74-5cad-84ce-4ebf9e1366cb with identifier: PD21728
2026-03-28 11:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef969f1c-0d74-5cad-84ce-4ebf9e1366cb with identifier: PD21728
2026-03-28 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ef969f1c-0d74-5cad-84ce-4ebf9e1366cb with identifier: PD21728 to the API
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:59:40Z',
 'fuel_type': 'diesel',
 'id': 'ef969f1c-0d74-5cad-84ce-4ebf9e1366cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD21728',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 102434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend',
 'transmission': 'automatic',
 'trim': 'lang Trend',
 'year': 2010}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD21728%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.es] INFO: Saving data for PD21728: {'auction_closing_time': 1774717180.0, 'created_time': 1774296327.481817, 'last_price_update_time': 1774696192.598042}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD21728') HTTP/1.1" 204 0
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: XK73032
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: TN29066
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT04886%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.es] INFO: Scrape type for RT04886: 0
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK86006%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.es] INFO: Scrape type for EK86006: 0
2026-03-28 11:09:52 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL12491%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.es] INFO: Scrape type for XL12491: 2
2026-03-28 11:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b835b3-1df9-5d0e-a86c-448c6a2218d9 with identifier: XL12491
2026-03-28 11:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b835b3-1df9-5d0e-a86c-448c6a2218d9 with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b835b3-1df9-5d0e-a86c-448c6a2218d9 with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50b835b3-1df9-5d0e-a86c-448c6a2218d9, identifier: XL12491
2026-03-28 11:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50b835b3-1df9-5d0e-a86c-448c6a2218d9 with identifier: XL12491
2026-03-28 11:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50b835b3-1df9-5d0e-a86c-448c6a2218d9 with identifier: XL12491
2026-03-28 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50b835b3-1df9-5d0e-a86c-448c6a2218d9 with identifier: XL12491 to the API
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:20:21Z',
 'fuel_type': 'petrol',
 'id': '50b835b3-1df9-5d0e-a86c-448c6a2218d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL12491',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 102675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 280 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL12491%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Saving data for XL12491: {'auction_closing_time': 1774714821.0, 'created_time': 1773864400.447497, 'last_price_update_time': 1774696193.03092}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XL12491') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC02097%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Scrape type for YC02097: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb with identifier: YC02097
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb, identifier: YC02097
2026-03-28 11:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb with identifier: YC02097
2026-03-28 11:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb with identifier: YC02097
2026-03-28 11:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6c02c3e2-78bf-536b-93fe-426ad2ddf2eb with identifier: YC02097 to the API
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:20:28Z',
 'fuel_type': 'petrol',
 'id': '6c02c3e2-78bf-536b-93fe-426ad2ddf2eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC02097',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 16822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2024}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC02097%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Saving data for YC02097: {'auction_closing_time': 1774714828.0, 'created_time': 1774609652.80369, 'last_price_update_time': 1774696193.518527}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC02097') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT16054%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Scrape type for ZT16054: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f014a796-7453-5508-9dd4-aebc90eeba7c with identifier: ZT16054
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f014a796-7453-5508-9dd4-aebc90eeba7c with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f014a796-7453-5508-9dd4-aebc90eeba7c with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f014a796-7453-5508-9dd4-aebc90eeba7c, identifier: ZT16054
2026-03-28 11:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f014a796-7453-5508-9dd4-aebc90eeba7c with identifier: ZT16054
2026-03-28 11:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f014a796-7453-5508-9dd4-aebc90eeba7c with identifier: ZT16054
2026-03-28 11:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f014a796-7453-5508-9dd4-aebc90eeba7c with identifier: ZT16054 to the API
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:28:04Z',
 'fuel_type': 'petrol',
 'id': 'f014a796-7453-5508-9dd4-aebc90eeba7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT16054',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 123809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-17',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2006}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT16054%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Saving data for ZT16054: {'auction_closing_time': 1774715284.0, 'created_time': 1773130591.87274, 'last_price_update_time': 1774696193.912443}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT16054') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.es] INFO: Channel: 24h | Page: 62 | totalHits: 2561 | hits on page: 40
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE34718%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Scrape type for LE34718: 0
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-28 11:09:53 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS51461%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.es] INFO: Scrape type for XS51461: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649, identifier: XS51461
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461
2026-03-28 11:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461 to the API
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:43:07Z',
 'fuel_type': 'petrol',
 'id': 'a26f7ff2-8ea6-50c3-b03c-a75dab6aa649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS51461',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 95077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T2 Momentum Core 2WD',
 'transmission': 'manual',
 'trim': 'Momentum Core 2WD',
 'year': 2021}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS51461%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Saving data for XS51461: {'auction_closing_time': 1774716187.0, 'created_time': 1773129807.893961, 'last_price_update_time': 1774696194.299273}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS51461') HTTP/1.1" 204 0
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT35195%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Scrape type for VT35195: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c660b4-474e-5eb7-89fd-bb5dfb143e92 with identifier: VT35195
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c660b4-474e-5eb7-89fd-bb5dfb143e92 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9c660b4-474e-5eb7-89fd-bb5dfb143e92 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9c660b4-474e-5eb7-89fd-bb5dfb143e92, identifier: VT35195
2026-03-28 11:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD85047%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Scrape type for ZD85047: 0
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD04984%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Scrape type for MD04984: 0
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT49974%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Scrape type for TT49974: 0
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-28 11:09:54 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM05329%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Scrape type for AM05329: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77cb4fb-2d27-5027-91d8-8936596c1c72 with identifier: AM05329
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77cb4fb-2d27-5027-91d8-8936596c1c72 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77cb4fb-2d27-5027-91d8-8936596c1c72 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b77cb4fb-2d27-5027-91d8-8936596c1c72, identifier: AM05329
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9c660b4-474e-5eb7-89fd-bb5dfb143e92 with identifier: VT35195
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9c660b4-474e-5eb7-89fd-bb5dfb143e92 with identifier: VT35195
2026-03-28 11:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9c660b4-474e-5eb7-89fd-bb5dfb143e92 with identifier: VT35195 to the API
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:22:11Z',
 'fuel_type': 'diesel',
 'id': 'd9c660b4-474e-5eb7-89fd-bb5dfb143e92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT35195',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 232890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-09',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2018}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT35195%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.es] INFO: Saving data for VT35195: {'auction_closing_time': 1774714931.0, 'created_time': 1774274784.591282, 'last_price_update_time': 1774696194.858413}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT35195') HTTP/1.1" 204 0
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b77cb4fb-2d27-5027-91d8-8936596c1c72 with identifier: AM05329
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b77cb4fb-2d27-5027-91d8-8936596c1c72 with identifier: AM05329
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b77cb4fb-2d27-5027-91d8-8936596c1c72 with identifier: AM05329 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:11:21Z',
 'fuel_type': 'diesel',
 'id': 'b77cb4fb-2d27-5027-91d8-8936596c1c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM05329',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 216839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-17',
 'seller_name': None,
 'title': 'Opel Antara 2.2 CDTI Selective 4x4',
 'transmission': 'manual',
 'trim': 'Selective 4x4',
 'year': 2012}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM05329%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.es] INFO: Saving data for AM05329: {'auction_closing_time': 1774714281.0, 'created_time': 1773126753.685814, 'last_price_update_time': 1774696195.216857}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM05329') HTTP/1.1" 204 0
2026-03-28 11:09:55 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-28 11:09:55 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80298%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.es] INFO: Scrape type for UD80298: 2
2026-03-28 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d30333e0-790c-530b-af55-4b7836ea3733 with identifier: UD80298
2026-03-28 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d30333e0-790c-530b-af55-4b7836ea3733 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d30333e0-790c-530b-af55-4b7836ea3733 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d30333e0-790c-530b-af55-4b7836ea3733, identifier: UD80298
2026-03-28 11:09:55 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-28 11:09:55 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG85850%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.es] INFO: Scrape type for JG85850: 2
2026-03-28 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc6c1fe7-7432-554c-a2a9-ba9a051c3787 with identifier: JG85850
2026-03-28 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc6c1fe7-7432-554c-a2a9-ba9a051c3787 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc6c1fe7-7432-554c-a2a9-ba9a051c3787 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc6c1fe7-7432-554c-a2a9-ba9a051c3787, identifier: JG85850
2026-03-28 11:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d30333e0-790c-530b-af55-4b7836ea3733 with identifier: UD80298
2026-03-28 11:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d30333e0-790c-530b-af55-4b7836ea3733 with identifier: UD80298
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d30333e0-790c-530b-af55-4b7836ea3733 with identifier: UD80298 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:09:47Z',
 'fuel_type': 'petrol',
 'id': 'd30333e0-790c-530b-af55-4b7836ea3733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD80298',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 131834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 43 AMG 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2017}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80298%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.es] INFO: Saving data for UD80298: {'auction_closing_time': 1774714187.0, 'created_time': 1774274784.201946, 'last_price_update_time': 1774696195.740383}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD80298') HTTP/1.1" 204 0
2026-03-28 11:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc6c1fe7-7432-554c-a2a9-ba9a051c3787 with identifier: JG85850
2026-03-28 11:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc6c1fe7-7432-554c-a2a9-ba9a051c3787 with identifier: JG85850
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc6c1fe7-7432-554c-a2a9-ba9a051c3787 with identifier: JG85850 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:03:26Z',
 'fuel_type': 'diesel',
 'id': 'fc6c1fe7-7432-554c-a2a9-ba9a051c3787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG85850',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 109466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-14',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Multivan Generation Six 4Motion',
 'year': 2017}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG85850%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.es] INFO: Saving data for JG85850: {'auction_closing_time': 1774713806.0, 'created_time': 1773129233.142183, 'last_price_update_time': 1774696196.042305}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG85850') HTTP/1.1" 204 0
2026-03-28 11:09:56 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.es] INFO: Scrape type for PH10774: 2
2026-03-28 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774
2026-03-28 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d755a4e7-d945-558b-87fa-d0e3e37edb04 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d755a4e7-d945-558b-87fa-d0e3e37edb04 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d755a4e7-d945-558b-87fa-d0e3e37edb04, identifier: PH10774
2026-03-28 11:09:56 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU04629%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.es] INFO: Scrape type for MU04629: 2
2026-03-28 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6dd41c4-3830-598c-8f68-95e85fe17b80 with identifier: MU04629
2026-03-28 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6dd41c4-3830-598c-8f68-95e85fe17b80 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6dd41c4-3830-598c-8f68-95e85fe17b80 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6dd41c4-3830-598c-8f68-95e85fe17b80, identifier: MU04629
2026-03-28 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774
2026-03-28 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774
2026-03-28 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774 to the API
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:43Z',
 'fuel_type': 'petrol',
 'id': 'd755a4e7-d945-558b-87fa-d0e3e37edb04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH10774',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 16981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-04',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2023}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.es] INFO: Saving data for PH10774: {'auction_closing_time': 1774715623.0, 'created_time': 1773843086.339079, 'last_price_update_time': 1774696196.738991}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH10774') HTTP/1.1" 204 0
2026-03-28 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6dd41c4-3830-598c-8f68-95e85fe17b80 with identifier: MU04629
2026-03-28 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6dd41c4-3830-598c-8f68-95e85fe17b80 with identifier: MU04629
2026-03-28 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6dd41c4-3830-598c-8f68-95e85fe17b80 with identifier: MU04629 to the API
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:25:46Z',
 'fuel_type': 'diesel',
 'id': 'e6dd41c4-3830-598c-8f68-95e85fe17b80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU04629',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 156798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2018}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU04629%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Saving data for MU04629: {'auction_closing_time': 1774715146.0, 'created_time': 1774609657.242989, 'last_price_update_time': 1774696197.012508}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MU04629') HTTP/1.1" 204 0
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL10193%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Scrape type for AL10193: 0
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR40846%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Scrape type for RR40846: 0
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR89235%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Scrape type for LR89235: 2
2026-03-28 11:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235
2026-03-28 11:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6655ee51-9da6-5e0c-9335-3242d967d70a with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6655ee51-9da6-5e0c-9335-3242d967d70a with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6655ee51-9da6-5e0c-9335-3242d967d70a, identifier: LR89235
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW15131%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Scrape type for MW15131: 0
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-28 11:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235
2026-03-28 11:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235
2026-03-28 11:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235 to the API
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'diesel',
 'id': '6655ee51-9da6-5e0c-9335-3242d967d70a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR89235',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 200344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR89235%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Saving data for LR89235: {'auction_closing_time': 1774716068.0, 'created_time': 1773130041.654229, 'last_price_update_time': 1774696197.471492}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LR89235') HTTP/1.1" 204 0
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU61809%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Scrape type for DU61809: 2
2026-03-28 11:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac75bae-8028-5f16-b451-9e7cfebc814d with identifier: DU61809
2026-03-28 11:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac75bae-8028-5f16-b451-9e7cfebc814d with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac75bae-8028-5f16-b451-9e7cfebc814d with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cac75bae-8028-5f16-b451-9e7cfebc814d, identifier: DU61809
2026-03-28 11:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cac75bae-8028-5f16-b451-9e7cfebc814d with identifier: DU61809
2026-03-28 11:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cac75bae-8028-5f16-b451-9e7cfebc814d with identifier: DU61809
2026-03-28 11:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cac75bae-8028-5f16-b451-9e7cfebc814d with identifier: DU61809 to the API
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:10Z',
 'fuel_type': 'diesel',
 'id': 'cac75bae-8028-5f16-b451-9e7cfebc814d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU61809',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 252959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-08',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU61809%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.es] INFO: Saving data for DU61809: {'auction_closing_time': 1774714630.0, 'created_time': 1774609659.267018, 'last_price_update_time': 1774696197.966288}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DU61809') HTTP/1.1" 204 0
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-28 11:09:57 [auto1.es] INFO: Found listing with ID: XZ30156
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ30156%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.es] INFO: Scrape type for XZ30156: 0
2026-03-28 11:09:58 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF66468%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.es] INFO: Scrape type for XF66468: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc with identifier: XF66468
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc, identifier: XF66468
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc with identifier: XF66468
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc with identifier: XF66468
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d64c9ca-83e8-5b62-b51a-746da8d9c2dc with identifier: XF66468 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:05:38Z',
 'fuel_type': 'petrol',
 'id': '8d64c9ca-83e8-5b62-b51a-746da8d9c2dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF66468',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 75663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-31',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2014}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF66468%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.es] INFO: Saving data for XF66468: {'auction_closing_time': 1774713938.0, 'created_time': 1773145439.46986, 'last_price_update_time': 1774696198.413031}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XF66468') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-28 11:09:58 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN13138%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.es] INFO: Scrape type for VN13138: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b48a987-fb35-560f-b40b-f47d46ab8def with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b48a987-fb35-560f-b40b-f47d46ab8def with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b48a987-fb35-560f-b40b-f47d46ab8def, identifier: VN13138
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:55Z',
 'fuel_type': 'diesel',
 'id': '6b48a987-fb35-560f-b40b-f47d46ab8def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN13138',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 189909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Sport BlueMotion',
 'transmission': 'manual',
 'trim': 'Sport BlueMotion',
 'year': 2016}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN13138%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.es] INFO: Saving data for VN13138: {'auction_closing_time': 1774713775.0, 'created_time': 1774296348.909116, 'last_price_update_time': 1774696198.853259}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VN13138') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-28 11:09:58 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA86748%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.es] INFO: Scrape type for YA86748: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d81311b2-6b82-54c6-9071-f1faf69c0e37 with identifier: YA86748
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d81311b2-6b82-54c6-9071-f1faf69c0e37 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d81311b2-6b82-54c6-9071-f1faf69c0e37 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d81311b2-6b82-54c6-9071-f1faf69c0e37, identifier: YA86748
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d81311b2-6b82-54c6-9071-f1faf69c0e37 with identifier: YA86748
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d81311b2-6b82-54c6-9071-f1faf69c0e37 with identifier: YA86748
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d81311b2-6b82-54c6-9071-f1faf69c0e37 with identifier: YA86748 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:10Z',
 'fuel_type': 'diesel',
 'id': 'd81311b2-6b82-54c6-9071-f1faf69c0e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA86748',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 224032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-17',
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Tonic',
 'transmission': 'manual',
 'trim': 'Tonic',
 'year': 2016}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA86748%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.es] INFO: Saving data for YA86748: {'auction_closing_time': 1774715110.0, 'created_time': 1773132587.135185, 'last_price_update_time': 1774696199.244369}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YA86748') HTTP/1.1" 204 0
2026-03-28 11:09:59 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-28 11:09:59 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-28 11:09:59 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT85498%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.es] INFO: Scrape type for YT85498: 2
2026-03-28 11:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498
2026-03-28 11:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea0bdd6c-790a-57c1-9798-6fe63f8d5473, identifier: YT85498
2026-03-28 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498
2026-03-28 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:32:17Z',
 'fuel_type': 'petrol',
 'id': 'ea0bdd6c-790a-57c1-9798-6fe63f8d5473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT85498',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 126335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-20',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2018}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT85498%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.es] INFO: Saving data for YT85498: {'auction_closing_time': 1774715537.0, 'created_time': 1773131680.852969, 'last_price_update_time': 1774696199.650296}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YT85498') HTTP/1.1" 204 0
2026-03-28 11:09:59 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ06267%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.es] INFO: Scrape type for VZ06267: 0
2026-03-28 11:09:59 [auto1.es] INFO: Found listing with ID: GC26553
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC26553%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.es] INFO: Scrape type for GC26553: 0
2026-03-28 11:09:59 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU03196%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.es] INFO: Scrape type for YU03196: 2
2026-03-28 11:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c with identifier: YU03196
2026-03-28 11:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c, identifier: YU03196
2026-03-28 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c with identifier: YU03196
2026-03-28 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c with identifier: YU03196
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c with identifier: YU03196 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:50:42Z',
 'fuel_type': 'petrol',
 'id': 'd1d31eb6-8e3c-52ef-9e0a-3ee1c9175d8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU03196',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 141597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-16',
 'seller_name': None,
 'title': 'Opel Astra 2.0 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2005}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU03196%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.es] INFO: Saving data for YU03196: {'auction_closing_time': 1774716642.0, 'created_time': 1774296618.897894, 'last_price_update_time': 1774696200.204968}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU03196') HTTP/1.1" 204 0
2026-03-28 11:10:00 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA92548%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.es] INFO: Scrape type for PA92548: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3acf367-61b8-54ac-b596-2dba1cebf0d3 with identifier: PA92548
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3acf367-61b8-54ac-b596-2dba1cebf0d3 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3acf367-61b8-54ac-b596-2dba1cebf0d3 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3acf367-61b8-54ac-b596-2dba1cebf0d3, identifier: PA92548
2026-03-28 11:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3acf367-61b8-54ac-b596-2dba1cebf0d3 with identifier: PA92548
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3acf367-61b8-54ac-b596-2dba1cebf0d3 with identifier: PA92548
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3acf367-61b8-54ac-b596-2dba1cebf0d3 with identifier: PA92548 to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:55Z',
 'fuel_type': 'petrol',
 'id': 'b3acf367-61b8-54ac-b596-2dba1cebf0d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA92548',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 183074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA92548%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.es] INFO: Saving data for PA92548: {'auction_closing_time': 1774713835.0, 'created_time': 1773129214.34848, 'last_price_update_time': 1774696200.608213}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA92548') HTTP/1.1" 204 0
2026-03-28 11:10:00 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ75829%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.es] INFO: Scrape type for JJ75829: 0
2026-03-28 11:10:00 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-28 11:10:00 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-28 11:10:00 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-28 11:10:00 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ16249%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.es] INFO: Scrape type for EJ16249: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa835099-38f6-56f2-80b5-a8e316384ead with identifier: EJ16249
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa835099-38f6-56f2-80b5-a8e316384ead with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa835099-38f6-56f2-80b5-a8e316384ead with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa835099-38f6-56f2-80b5-a8e316384ead, identifier: EJ16249
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa835099-38f6-56f2-80b5-a8e316384ead with identifier: EJ16249
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa835099-38f6-56f2-80b5-a8e316384ead with identifier: EJ16249
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa835099-38f6-56f2-80b5-a8e316384ead with identifier: EJ16249 to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:01:37Z',
 'fuel_type': 'petrol',
 'id': 'fa835099-38f6-56f2-80b5-a8e316384ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ16249',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 96384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.6 Line 4x2',
 'transmission': 'manual',
 'trim': 'Line 4x2',
 'year': 2015}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ16249%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Saving data for EJ16249: {'auction_closing_time': 1774713697.0, 'created_time': 1774296499.149138, 'last_price_update_time': 1774696201.046497}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EJ16249') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH45112%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Scrape type for UH45112: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98db335e-17c5-54bc-864a-1a91f8c22352 with identifier: UH45112
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98db335e-17c5-54bc-864a-1a91f8c22352 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98db335e-17c5-54bc-864a-1a91f8c22352 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98db335e-17c5-54bc-864a-1a91f8c22352, identifier: UH45112
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98db335e-17c5-54bc-864a-1a91f8c22352 with identifier: UH45112
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98db335e-17c5-54bc-864a-1a91f8c22352 with identifier: UH45112
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98db335e-17c5-54bc-864a-1a91f8c22352 with identifier: UH45112 to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:27:00Z',
 'fuel_type': 'gas',
 'id': '98db335e-17c5-54bc-864a-1a91f8c22352',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH45112',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 283982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-17',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo LPG Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2017}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH45112%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Saving data for UH45112: {'auction_closing_time': 1774715220.0, 'created_time': 1774274819.665975, 'last_price_update_time': 1774696201.435409}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UH45112') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.es] INFO: Channel: 24h | Page: 63 | totalHits: 2561 | hits on page: 40
2026-03-28 11:10:01 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ42678%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Scrape type for DZ42678: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1c3845f-fe9e-54bd-b101-09d8030a29f3 with identifier: DZ42678
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c3845f-fe9e-54bd-b101-09d8030a29f3 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1c3845f-fe9e-54bd-b101-09d8030a29f3 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1c3845f-fe9e-54bd-b101-09d8030a29f3, identifier: DZ42678
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1c3845f-fe9e-54bd-b101-09d8030a29f3 with identifier: DZ42678
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1c3845f-fe9e-54bd-b101-09d8030a29f3 with identifier: DZ42678
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1c3845f-fe9e-54bd-b101-09d8030a29f3 with identifier: DZ42678 to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:49Z',
 'fuel_type': 'petrol',
 'id': 'b1c3845f-fe9e-54bd-b101-09d8030a29f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ42678',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 135984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-30',
 'seller_name': None,
 'title': 'BMW 3er 318Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ42678%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Saving data for DZ42678: {'auction_closing_time': 1774715929.0, 'created_time': 1773133607.723117, 'last_price_update_time': 1774696201.8219}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DZ42678') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-28 11:10:01 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX99272%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Scrape type for KX99272: 0
2026-03-28 11:10:01 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-28 11:10:01 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE85496%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.es] INFO: Scrape type for ZE85496: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f with identifier: ZE85496
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f, identifier: ZE85496
2026-03-28 11:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:02 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-28 11:10:02 [auto1.es] INFO: Found listing with ID: FK61059
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK61059%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.es] INFO: Scrape type for FK61059: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd with identifier: FK61059
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd, identifier: FK61059
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f with identifier: ZE85496
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f with identifier: ZE85496
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f with identifier: ZE85496 to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:17:21Z',
 'fuel_type': 'diesel',
 'id': '1fec4b22-4ad0-5b3d-a3b6-b81c2d4e004f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE85496',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 24760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar D200 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2021}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE85496%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.es] INFO: Saving data for ZE85496: {'auction_closing_time': 1774714641.0, 'created_time': 1774350386.319015, 'last_price_update_time': 1774696202.417039}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE85496') HTTP/1.1" 204 0
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd with identifier: FK61059
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd with identifier: FK61059
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd with identifier: FK61059 to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:25:33Z',
 'fuel_type': 'diesel',
 'id': 'e5f7b8c5-0f6f-5a54-bd66-77a4bf43cedd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK61059',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 186906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-24',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK61059%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.es] INFO: Saving data for FK61059: {'auction_closing_time': 1774715133.0, 'created_time': 1772623090.405511, 'last_price_update_time': 1774696202.71579}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK61059') HTTP/1.1" 204 0
2026-03-28 11:10:02 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT81282%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.es] INFO: Scrape type for RT81282: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b996a85-0297-523d-9a0b-764dc2275d5f with identifier: RT81282
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b996a85-0297-523d-9a0b-764dc2275d5f with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b996a85-0297-523d-9a0b-764dc2275d5f with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b996a85-0297-523d-9a0b-764dc2275d5f, identifier: RT81282
2026-03-28 11:10:02 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC98401%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.es] INFO: Scrape type for VC98401: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe97d5b9-50c2-5125-b664-ac93e19240fd with identifier: VC98401
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe97d5b9-50c2-5125-b664-ac93e19240fd with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe97d5b9-50c2-5125-b664-ac93e19240fd with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe97d5b9-50c2-5125-b664-ac93e19240fd, identifier: VC98401
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b996a85-0297-523d-9a0b-764dc2275d5f with identifier: RT81282
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b996a85-0297-523d-9a0b-764dc2275d5f with identifier: RT81282
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b996a85-0297-523d-9a0b-764dc2275d5f with identifier: RT81282 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:47:57Z',
 'fuel_type': 'diesel',
 'id': '4b996a85-0297-523d-9a0b-764dc2275d5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT81282',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 207957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-09',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT81282%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.es] INFO: Saving data for RT81282: {'auction_closing_time': 1774716477.0, 'created_time': 1774274828.329022, 'last_price_update_time': 1774696203.216835}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT81282') HTTP/1.1" 204 0
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe97d5b9-50c2-5125-b664-ac93e19240fd with identifier: VC98401
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe97d5b9-50c2-5125-b664-ac93e19240fd with identifier: VC98401
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe97d5b9-50c2-5125-b664-ac93e19240fd with identifier: VC98401 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:55:16Z',
 'fuel_type': 'diesel',
 'id': 'fe97d5b9-50c2-5125-b664-ac93e19240fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC98401',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 175085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2016}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC98401%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.es] INFO: Saving data for VC98401: {'auction_closing_time': 1774716916.0, 'created_time': 1773127239.287295, 'last_price_update_time': 1774696203.546276}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC98401') HTTP/1.1" 204 0
2026-03-28 11:10:03 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-28 11:10:03 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP11260%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.es] INFO: Scrape type for JP11260: 2
2026-03-28 11:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8022339a-1840-5336-a997-0ba425260380 with identifier: JP11260
2026-03-28 11:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8022339a-1840-5336-a997-0ba425260380 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8022339a-1840-5336-a997-0ba425260380 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8022339a-1840-5336-a997-0ba425260380, identifier: JP11260
2026-03-28 11:10:03 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS29729%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.es] INFO: Scrape type for PS29729: 2
2026-03-28 11:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d535b7e3-0d20-5ede-ba94-94a1d90e8496 with identifier: PS29729
2026-03-28 11:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d535b7e3-0d20-5ede-ba94-94a1d90e8496 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d535b7e3-0d20-5ede-ba94-94a1d90e8496 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d535b7e3-0d20-5ede-ba94-94a1d90e8496, identifier: PS29729
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8022339a-1840-5336-a997-0ba425260380 with identifier: JP11260
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8022339a-1840-5336-a997-0ba425260380 with identifier: JP11260
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8022339a-1840-5336-a997-0ba425260380 with identifier: JP11260 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:34:06Z',
 'fuel_type': 'diesel',
 'id': '8022339a-1840-5336-a997-0ba425260380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP11260',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 73007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-20',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2008}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP11260%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.es] INFO: Saving data for JP11260: {'auction_closing_time': 1774715646.0, 'created_time': 1773832529.83626, 'last_price_update_time': 1774696204.044901}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JP11260') HTTP/1.1" 204 0
2026-03-28 11:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d535b7e3-0d20-5ede-ba94-94a1d90e8496 with identifier: PS29729
2026-03-28 11:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d535b7e3-0d20-5ede-ba94-94a1d90e8496 with identifier: PS29729
2026-03-28 11:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d535b7e3-0d20-5ede-ba94-94a1d90e8496 with identifier: PS29729 to the API
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:26:30Z',
 'fuel_type': 'diesel',
 'id': 'd535b7e3-0d20-5ede-ba94-94a1d90e8496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS29729',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 142552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-26',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS29729%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.es] INFO: Saving data for PS29729: {'auction_closing_time': 1774715190.0, 'created_time': 1773129532.065779, 'last_price_update_time': 1774696204.444574}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS29729') HTTP/1.1" 204 0
2026-03-28 11:10:04 [auto1.es] INFO: Found listing with ID: MW05620
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW05620%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.es] INFO: Scrape type for MW05620: 2
2026-03-28 11:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b091e991-1dd2-52b0-b729-be37148fa43f with identifier: MW05620
2026-03-28 11:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b091e991-1dd2-52b0-b729-be37148fa43f with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b091e991-1dd2-52b0-b729-be37148fa43f with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b091e991-1dd2-52b0-b729-be37148fa43f, identifier: MW05620
2026-03-28 11:10:04 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-28 11:10:04 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP51440%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.es] INFO: Scrape type for ZP51440: 2
2026-03-28 11:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440
2026-03-28 11:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675, identifier: ZP51440
2026-03-28 11:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b091e991-1dd2-52b0-b729-be37148fa43f with identifier: MW05620
2026-03-28 11:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b091e991-1dd2-52b0-b729-be37148fa43f with identifier: MW05620
2026-03-28 11:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b091e991-1dd2-52b0-b729-be37148fa43f with identifier: MW05620 to the API
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:09:58Z',
 'fuel_type': 'petrol',
 'id': 'b091e991-1dd2-52b0-b729-be37148fa43f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW05620',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 85063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2018}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW05620%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.es] INFO: Saving data for MW05620: {'auction_closing_time': 1774714198.0, 'created_time': 1772623799.437212, 'last_price_update_time': 1774696204.948353}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW05620') HTTP/1.1" 204 0
2026-03-28 11:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440
2026-03-28 11:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440
2026-03-28 11:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440 to the API
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:43:57Z',
 'fuel_type': 'petrol',
 'id': 'cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP51440',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 236112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP51440%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.es] INFO: Saving data for ZP51440: {'auction_closing_time': 1774716237.0, 'created_time': 1773131465.951111, 'last_price_update_time': 1774696205.232024}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZP51440') HTTP/1.1" 204 0
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ86093%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.es] INFO: Scrape type for UZ86093: 0
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM69944%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.es] INFO: Scrape type for ZM69944: 2
2026-03-28 11:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944
2026-03-28 11:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c, identifier: ZM69944
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-28 11:10:05 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY16020%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.es] INFO: Scrape type for NY16020: 2
2026-03-28 11:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 336d9bc3-ca25-5a05-ac59-bf583b0205c1 with identifier: NY16020
2026-03-28 11:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 336d9bc3-ca25-5a05-ac59-bf583b0205c1 with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 336d9bc3-ca25-5a05-ac59-bf583b0205c1 with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 336d9bc3-ca25-5a05-ac59-bf583b0205c1, identifier: NY16020
2026-03-28 11:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944
2026-03-28 11:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944
2026-03-28 11:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944 to the API
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:23:41Z',
 'fuel_type': 'hybrid',
 'id': 'b4581c3e-8a4a-5be0-9f23-6b2390f5f81c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM69944',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 195715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-01',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi Hybrid4 Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2013}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM69944%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.es] INFO: Saving data for ZM69944: {'auction_closing_time': 1774715021.0, 'created_time': 1773843230.054542, 'last_price_update_time': 1774696205.752372}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM69944') HTTP/1.1" 204 0
2026-03-28 11:10:05 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 9 pages/min), scraped 256 items (at 138 items/min)
2026-03-28 11:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-28 11:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 336d9bc3-ca25-5a05-ac59-bf583b0205c1 with identifier: NY16020
2026-03-28 11:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 336d9bc3-ca25-5a05-ac59-bf583b0205c1 with identifier: NY16020
2026-03-28 11:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 336d9bc3-ca25-5a05-ac59-bf583b0205c1 with identifier: NY16020 to the API
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:14:58Z',
 'fuel_type': 'diesel',
 'id': '336d9bc3-ca25-5a05-ac59-bf583b0205c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY16020',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 221941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic Urban',
 'transmission': 'automatic',
 'trim': '4Matic Urban',
 'year': 2018}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY16020%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Saving data for NY16020: {'auction_closing_time': 1774714498.0, 'created_time': 1773864367.526036, 'last_price_update_time': 1774696206.033545}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY16020') HTTP/1.1" 204 0
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD21856%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Scrape type for UD21856: 0
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF95473%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Scrape type for UF95473: 2
2026-03-28 11:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 252322d6-c3d1-5225-935c-fbf67f07bc98 with identifier: UF95473
2026-03-28 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 252322d6-c3d1-5225-935c-fbf67f07bc98 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 252322d6-c3d1-5225-935c-fbf67f07bc98 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 252322d6-c3d1-5225-935c-fbf67f07bc98, identifier: UF95473
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-28 11:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 252322d6-c3d1-5225-935c-fbf67f07bc98 with identifier: UF95473
2026-03-28 11:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 252322d6-c3d1-5225-935c-fbf67f07bc98 with identifier: UF95473
2026-03-28 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 252322d6-c3d1-5225-935c-fbf67f07bc98 with identifier: UF95473 to the API
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:02:17Z',
 'fuel_type': 'petrol',
 'id': '252322d6-c3d1-5225-935c-fbf67f07bc98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF95473',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ6',
 'odometer': 155418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-03-01',
 'seller_name': None,
 'title': 'Jaguar XJ6 3.2 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 1995}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF95473%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Saving data for UF95473: {'auction_closing_time': 1774713737.0, 'created_time': 1774015714.482163, 'last_price_update_time': 1774696206.450728}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF95473') HTTP/1.1" 204 0
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: ZW56409
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: RD21311
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD21311%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Scrape type for RD21311: 2
2026-03-28 11:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec9a9bd-126c-5cda-9959-126ef0434ab9 with identifier: RD21311
2026-03-28 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec9a9bd-126c-5cda-9959-126ef0434ab9 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec9a9bd-126c-5cda-9959-126ef0434ab9 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bec9a9bd-126c-5cda-9959-126ef0434ab9, identifier: RD21311
2026-03-28 11:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bec9a9bd-126c-5cda-9959-126ef0434ab9 with identifier: RD21311
2026-03-28 11:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bec9a9bd-126c-5cda-9959-126ef0434ab9 with identifier: RD21311
2026-03-28 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bec9a9bd-126c-5cda-9959-126ef0434ab9 with identifier: RD21311 to the API
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:23Z',
 'fuel_type': 'diesel',
 'id': 'bec9a9bd-126c-5cda-9959-126ef0434ab9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD21311',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 122004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
 'transmission': 'manual',
 'trim': '33 L2H2 Club Start&Stop',
 'year': 2020}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD21311%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Saving data for RD21311: {'auction_closing_time': 1774714343.0, 'created_time': 1774609663.698365, 'last_price_update_time': 1774696206.94539}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD21311') HTTP/1.1" 204 0
2026-03-28 11:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: XJ78592
2026-03-28 11:10:06 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU29422%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.es] INFO: Scrape type for FU29422: 2
2026-03-28 11:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422
2026-03-28 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65368c80-465c-562d-8dd9-8caeddd91714 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65368c80-465c-562d-8dd9-8caeddd91714 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65368c80-465c-562d-8dd9-8caeddd91714, identifier: FU29422
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422
2026-03-28 11:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422 to the API
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:07:15Z',
 'fuel_type': 'petrol',
 'id': '65368c80-465c-562d-8dd9-8caeddd91714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU29422',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 56087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU29422%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.es] INFO: Saving data for FU29422: {'auction_closing_time': 1774714035.0, 'created_time': 1773128000.672286, 'last_price_update_time': 1774696207.444825}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FU29422') HTTP/1.1" 204 0
2026-03-28 11:10:07 [auto1.es] INFO: Found listing with ID: NG83144
2026-03-28 11:10:07 [auto1.es] INFO: Found listing with ID: KH84544
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH84544%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.es] INFO: Scrape type for KH84544: 2
2026-03-28 11:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6 with identifier: KH84544
2026-03-28 11:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6, identifier: KH84544
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6 with identifier: KH84544
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6 with identifier: KH84544
2026-03-28 11:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 256e5b44-99f2-5d7f-a1cf-e385c1d95cf6 with identifier: KH84544 to the API
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:55:51Z',
 'fuel_type': 'diesel',
 'id': '256e5b44-99f2-5d7f-a1cf-e385c1d95cf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH84544',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 111976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Business XL',
 'transmission': 'manual',
 'trim': 'Business XL',
 'year': 2017}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH84544%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.es] INFO: Saving data for KH84544: {'auction_closing_time': 1774716951.0, 'created_time': 1774609663.150712, 'last_price_update_time': 1774696207.83103}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH84544') HTTP/1.1" 204 0
2026-03-28 11:10:07 [auto1.es] INFO: Found listing with ID: LM59241
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM59241%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.es] INFO: Scrape type for LM59241: 2
2026-03-28 11:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047021e2-c27d-594b-a4b8-f0b91bfdd6bb with identifier: LM59241
2026-03-28 11:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047021e2-c27d-594b-a4b8-f0b91bfdd6bb with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047021e2-c27d-594b-a4b8-f0b91bfdd6bb with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 047021e2-c27d-594b-a4b8-f0b91bfdd6bb, identifier: LM59241
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 047021e2-c27d-594b-a4b8-f0b91bfdd6bb with identifier: LM59241
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 047021e2-c27d-594b-a4b8-f0b91bfdd6bb with identifier: LM59241
2026-03-28 11:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 047021e2-c27d-594b-a4b8-f0b91bfdd6bb with identifier: LM59241 to the API
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:34:34Z',
 'fuel_type': 'diesel',
 'id': '047021e2-c27d-594b-a4b8-f0b91bfdd6bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM59241',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 180586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-01',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2008}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM59241%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [auto1.es] INFO: Saving data for LM59241: {'auction_closing_time': 1774715674.0, 'created_time': 1773832813.216785, 'last_price_update_time': 1774696208.220543}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LM59241') HTTP/1.1" 204 0
2026-03-28 11:10:08 [auto1.es] INFO: Channel: 24h | Page: 64 | totalHits: 2561 | hits on page: 40
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: TF39547
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: UT93063
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA94101%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [auto1.es] INFO: Scrape type for WA94101: 0
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: VJ59554
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ59554%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [auto1.es] INFO: Scrape type for VJ59554: 2
2026-03-28 11:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be92ad1c-231f-595e-aa5f-42a16f57830c with identifier: VJ59554
2026-03-28 11:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be92ad1c-231f-595e-aa5f-42a16f57830c with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be92ad1c-231f-595e-aa5f-42a16f57830c with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be92ad1c-231f-595e-aa5f-42a16f57830c, identifier: VJ59554
2026-03-28 11:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be92ad1c-231f-595e-aa5f-42a16f57830c with identifier: VJ59554
2026-03-28 11:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be92ad1c-231f-595e-aa5f-42a16f57830c with identifier: VJ59554
2026-03-28 11:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be92ad1c-231f-595e-aa5f-42a16f57830c with identifier: VJ59554 to the API
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:06:31Z',
 'fuel_type': 'diesel',
 'id': 'be92ad1c-231f-595e-aa5f-42a16f57830c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ59554',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 92143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L3H2 Business',
 'transmission': 'manual',
 'trim': '35 L3H2 Business',
 'year': 2018}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ59554%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [auto1.es] INFO: Saving data for VJ59554: {'auction_closing_time': 1774713991.0, 'created_time': 1774609661.469469, 'last_price_update_time': 1774696208.622423}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ59554') HTTP/1.1" 204 0
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK95363%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [auto1.es] INFO: Scrape type for TK95363: 2
2026-03-28 11:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f9af03-8b51-5f49-9c8f-4fd080f9f559 with identifier: TK95363
2026-03-28 11:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f9af03-8b51-5f49-9c8f-4fd080f9f559 with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f9af03-8b51-5f49-9c8f-4fd080f9f559 with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c9f9af03-8b51-5f49-9c8f-4fd080f9f559, identifier: TK95363
2026-03-28 11:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: MJ93698
2026-03-28 11:10:08 [auto1.es] INFO: Found listing with ID: RA85318
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA85318%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [auto1.es] INFO: Scrape type for RA85318: 2
2026-03-28 11:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f88d59-acd7-54c8-b68f-81d7e180e20d with identifier: RA85318
2026-03-28 11:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f88d59-acd7-54c8-b68f-81d7e180e20d with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f88d59-acd7-54c8-b68f-81d7e180e20d with scrape type 2
2026-03-28 11:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42f88d59-acd7-54c8-b68f-81d7e180e20d, identifier: RA85318
2026-03-28 11:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c9f9af03-8b51-5f49-9c8f-4fd080f9f559 with identifier: TK95363
2026-03-28 11:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c9f9af03-8b51-5f49-9c8f-4fd080f9f559 with identifier: TK95363
2026-03-28 11:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c9f9af03-8b51-5f49-9c8f-4fd080f9f559 with identifier: TK95363 to the API
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:10:30Z',
 'fuel_type': 'hybrid',
 'id': 'c9f9af03-8b51-5f49-9c8f-4fd080f9f559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK95363',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 26264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid Drive 4WD',
 'transmission': 'automatic',
 'trim': 'Drive 4WD',
 'year': 2022}
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK95363%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [auto1.es] INFO: Saving data for TK95363: {'auction_closing_time': 1774714230.0, 'created_time': 1773324541.030105, 'last_price_update_time': 1774696209.298252}
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TK95363') HTTP/1.1" 204 0
2026-03-28 11:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42f88d59-acd7-54c8-b68f-81d7e180e20d with identifier: RA85318
2026-03-28 11:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42f88d59-acd7-54c8-b68f-81d7e180e20d with identifier: RA85318
2026-03-28 11:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42f88d59-acd7-54c8-b68f-81d7e180e20d with identifier: RA85318 to the API
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:22:43Z',
 'fuel_type': 'diesel',
 'id': '42f88d59-acd7-54c8-b68f-81d7e180e20d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA85318',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 134690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-07',
 'seller_name': None,
 'title': 'Toyota Land Cruiser 2.8 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA85318%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [auto1.es] INFO: Saving data for RA85318: {'auction_closing_time': 1774714963.0, 'created_time': 1774609664.449812, 'last_price_update_time': 1774696209.600741}
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA85318') HTTP/1.1" 204 0
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: BE90053
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE90053%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [auto1.es] INFO: Scrape type for BE90053: 0
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV58793%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [auto1.es] INFO: Scrape type for HV58793: 0
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF90515%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [auto1.es] INFO: Scrape type for YF90515: 2
2026-03-28 11:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12de6db-ce2a-58d6-9938-2916b94cdbde with identifier: YF90515
2026-03-28 11:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12de6db-ce2a-58d6-9938-2916b94cdbde with scrape type 2
2026-03-28 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c12de6db-ce2a-58d6-9938-2916b94cdbde with scrape type 2
2026-03-28 11:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c12de6db-ce2a-58d6-9938-2916b94cdbde, identifier: YF90515
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: RC37181
2026-03-28 11:10:09 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV37790%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [auto1.es] INFO: Scrape type for KV37790: 0
2026-03-28 11:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c12de6db-ce2a-58d6-9938-2916b94cdbde with identifier: YF90515
2026-03-28 11:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c12de6db-ce2a-58d6-9938-2916b94cdbde with identifier: YF90515
2026-03-28 11:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c12de6db-ce2a-58d6-9938-2916b94cdbde with identifier: YF90515 to the API
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:26:53Z',
 'fuel_type': 'petrol',
 'id': 'c12de6db-ce2a-58d6-9938-2916b94cdbde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF90515',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 64294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2020}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF90515%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [auto1.es] INFO: Saving data for YF90515: {'auction_closing_time': 1774715213.0, 'created_time': 1773295276.628456, 'last_price_update_time': 1774696210.149591}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF90515') HTTP/1.1" 204 0
2026-03-28 11:10:10 [auto1.es] INFO: Found listing with ID: TL16652
2026-03-28 11:10:10 [auto1.es] INFO: Found listing with ID: ET37328
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET37328%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [auto1.es] INFO: Scrape type for ET37328: 2
2026-03-28 11:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b678567-2a82-5394-8109-849c93322d98 with identifier: ET37328
2026-03-28 11:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b678567-2a82-5394-8109-849c93322d98 with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b678567-2a82-5394-8109-849c93322d98 with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b678567-2a82-5394-8109-849c93322d98, identifier: ET37328
2026-03-28 11:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b678567-2a82-5394-8109-849c93322d98 with identifier: ET37328
2026-03-28 11:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b678567-2a82-5394-8109-849c93322d98 with identifier: ET37328
2026-03-28 11:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b678567-2a82-5394-8109-849c93322d98 with identifier: ET37328 to the API
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:11:41Z',
 'fuel_type': 'diesel',
 'id': '2b678567-2a82-5394-8109-849c93322d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET37328',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 88779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2021}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET37328%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [auto1.es] INFO: Saving data for ET37328: {'auction_closing_time': 1774714301.0, 'created_time': 1774609670.452748, 'last_price_update_time': 1774696210.620127}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET37328') HTTP/1.1" 204 0
2026-03-28 11:10:10 [auto1.es] INFO: Found listing with ID: VB46301
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB46301%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [auto1.es] INFO: Scrape type for VB46301: 2
2026-03-28 11:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d04c602c-9316-59d9-b7f8-791bf5b856b1 with identifier: VB46301
2026-03-28 11:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d04c602c-9316-59d9-b7f8-791bf5b856b1 with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d04c602c-9316-59d9-b7f8-791bf5b856b1 with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d04c602c-9316-59d9-b7f8-791bf5b856b1, identifier: VB46301
2026-03-28 11:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d04c602c-9316-59d9-b7f8-791bf5b856b1 with identifier: VB46301
2026-03-28 11:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d04c602c-9316-59d9-b7f8-791bf5b856b1 with identifier: VB46301
2026-03-28 11:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d04c602c-9316-59d9-b7f8-791bf5b856b1 with identifier: VB46301 to the API
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:51:51Z',
 'fuel_type': 'diesel',
 'id': 'd04c602c-9316-59d9-b7f8-791bf5b856b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB46301',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 138079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-31',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 333 L2H2 Pro BlueHDi 110',
 'transmission': 'manual',
 'trim': '333 L2H2 Pro BlueHDi 110',
 'year': 2019}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB46301%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [auto1.es] INFO: Saving data for VB46301: {'auction_closing_time': 1774716711.0, 'created_time': 1774609669.050466, 'last_price_update_time': 1774696210.99455}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB46301') HTTP/1.1" 204 0
2026-03-28 11:10:11 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU85789%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [auto1.es] INFO: Scrape type for SU85789: 2
2026-03-28 11:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789
2026-03-28 11:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31364266-138b-569b-9e5a-943d3de37e5b with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31364266-138b-569b-9e5a-943d3de37e5b with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31364266-138b-569b-9e5a-943d3de37e5b, identifier: SU85789
2026-03-28 11:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789
2026-03-28 11:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789
2026-03-28 11:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789 to the API
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:39:11Z',
 'fuel_type': 'petrol',
 'id': '31364266-138b-569b-9e5a-943d3de37e5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU85789',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 156185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-10',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2014}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU85789%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [auto1.es] INFO: Saving data for SU85789: {'auction_closing_time': 1774715951.0, 'created_time': 1774609665.938666, 'last_price_update_time': 1774696211.378379}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU85789') HTTP/1.1" 204 0
2026-03-28 11:10:11 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-28 11:10:11 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY04008%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [auto1.es] INFO: Scrape type for CY04008: 2
2026-03-28 11:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbd4bcdb-e048-54a3-9442-0502da46cdc9 with identifier: CY04008
2026-03-28 11:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbd4bcdb-e048-54a3-9442-0502da46cdc9 with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbd4bcdb-e048-54a3-9442-0502da46cdc9 with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fbd4bcdb-e048-54a3-9442-0502da46cdc9, identifier: CY04008
2026-03-28 11:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fbd4bcdb-e048-54a3-9442-0502da46cdc9 with identifier: CY04008
2026-03-28 11:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fbd4bcdb-e048-54a3-9442-0502da46cdc9 with identifier: CY04008
2026-03-28 11:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fbd4bcdb-e048-54a3-9442-0502da46cdc9 with identifier: CY04008 to the API
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:53Z',
 'fuel_type': 'diesel',
 'id': 'fbd4bcdb-e048-54a3-9442-0502da46cdc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY04008',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 138842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-25',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi SX',
 'transmission': 'automatic',
 'trim': 'SX',
 'year': 2008}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY04008%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [auto1.es] INFO: Saving data for CY04008: {'auction_closing_time': 1774714133.0, 'created_time': 1772753070.739428, 'last_price_update_time': 1774696211.812457}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CY04008') HTTP/1.1" 204 0
2026-03-28 11:10:11 [auto1.es] INFO: Found listing with ID: NV45891
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV45891%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [auto1.es] INFO: Scrape type for NV45891: 2
2026-03-28 11:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6698a92a-6d2f-5c90-97f0-7492c9cbae2a with identifier: NV45891
2026-03-28 11:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6698a92a-6d2f-5c90-97f0-7492c9cbae2a with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6698a92a-6d2f-5c90-97f0-7492c9cbae2a with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6698a92a-6d2f-5c90-97f0-7492c9cbae2a, identifier: NV45891
2026-03-28 11:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6698a92a-6d2f-5c90-97f0-7492c9cbae2a with identifier: NV45891
2026-03-28 11:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6698a92a-6d2f-5c90-97f0-7492c9cbae2a with identifier: NV45891
2026-03-28 11:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6698a92a-6d2f-5c90-97f0-7492c9cbae2a with identifier: NV45891 to the API
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:17:09Z',
 'fuel_type': 'petrol',
 'id': '6698a92a-6d2f-5c90-97f0-7492c9cbae2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV45891',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 130621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2022}
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV45891%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Saving data for NV45891: {'auction_closing_time': 1774714629.0, 'created_time': 1774609670.121611, 'last_price_update_time': 1774696212.192959}
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NV45891') HTTP/1.1" 204 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS96167%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for NS96167: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV58633%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for XV58633: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV89988%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for UV89988: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB36142%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for SB36142: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU20141%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for UU20141: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: ND20390
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA13811%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for CA13811: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM06943%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for VM06943: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE94512%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for GE94512: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM44751%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for NM44751: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: HD74513
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD74513%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for HD74513: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT92698%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for GT92698: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: VN26021
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH54771%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for WH54771: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL75511%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for NL75511: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW97634%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for WW97634: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD86160%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for SD86160: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43561%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for HF43561: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP85710%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [auto1.es] INFO: Scrape type for PP85710: 0
2026-03-28 11:10:12 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-28 11:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:13 [auto1.es] INFO: Channel: 24h | Page: 65 | totalHits: 2562 | hits on page: 2
2026-03-28 11:10:13 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-28 11:10:13 [auto1.es] INFO: Found listing with ID: ZL14108
2026-03-28 11:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:14 [auto1.es] INFO: Channel: 24h | Page: 66 | totalHits: 2562 | hits on page: 0
2026-03-28 11:10:14 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 11:10:14 [auto1.es] INFO: auto1.es Batch config: batch 2/2
2026-03-28 11:10:14 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 5, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 17, <ScrapeType.BATCH_SKIPPED: 5>: 11}
2026-03-28 11:10:14 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (271 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_22_2026-03-28T11_05_00.jl
2026-03-28 11:10:14 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 23,
 'downloader/exception_type_count/twisted.internet.error.ConnectError': 16,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 7,
 'downloader/request_bytes': 1162179,
 'downloader/request_count': 650,
 'downloader/request_method_count/GET': 582,
 'downloader/request_method_count/POST': 68,
 'downloader/response_bytes': 49055034,
 'downloader/response_count': 627,
 'downloader/response_status_count/200': 627,
 'dupefilter/filtered': 19,
 'elapsed_time_seconds': 308.907655,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 11, 10, 14, 130942, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 271,
 'log_count/DEBUG': 8288,
 'log_count/INFO': 9437,
 'memusage/max': 172797952,
 'memusage/startup': 149860352,
 'photo_download_count': 429,
 'request_depth_max': 69,
 'response_received_count': 198,
 'scheduler/dequeued': 650,
 'scheduler/dequeued/memory': 650,
 'scheduler/enqueued': 650,
 'scheduler/enqueued/memory': 650,
 'scrape_type/batch_skipped': 1281,
 'scrape_type/new': 64,
 'scrape_type/price_update': 207,
 'scrape_type/skipped': 1031,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 198,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.0535069799728016,
 'scrapy-zyte-api/mean_response_seconds': 2.100394756664908,
 'scrapy-zyte-api/processed': 198,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 198,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 197,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 198,
 'scrapy-zyte-api/request_args/httpRequestBody': 68,
 'scrapy-zyte-api/request_args/httpRequestMethod': 68,
 'scrapy-zyte-api/request_args/httpResponseBody': 198,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 198,
 'scrapy-zyte-api/request_args/sessionContext': 198,
 'scrapy-zyte-api/request_args/url': 198,
 'scrapy-zyte-api/status_codes/200': 198,
 'scrapy-zyte-api/success': 198,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 2602,
 'source/total_available': 2562,
 'start_time': datetime.datetime(2026, 3, 28, 11, 5, 5, 223287, tzinfo=datetime.timezone.utc)}
2026-03-28 11:10:14 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 11:10:14 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f97f83299d0>
2026-03-28 11:10:14 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f97f8457f90>